-- Logs begin at Thu 2022-07-28 21:06:06 UTC, end at Thu 2022-07-28 22:45:48 UTC. -- Jul 28 22:19:21.058233 dv-cinder-850939-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 22:19:21.068676 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 22:19:21 2022] *** Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: nodename: dv-cinder-850939-3-iscsi Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: machine: x86_64 Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: clock source: unix Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: pcre jit disabled Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: detected number of CPU cores: 4 Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: current working directory: / Jul 28 22:19:21.070695 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: detected binary path: /usr/bin/uwsgi-core Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: your processes number limit is 47680 Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: your memory page size is 4096 bytes Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: detected max file descriptor number: 2048 Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: lock engine: pthread robust mutexes Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: thunder lock: enabled Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 22:19:21.071404 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 22:19:21.111826 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: Python main interpreter initialized at 0x561bf7fd39c0 Jul 28 22:19:21.111826 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: python threads support enabled Jul 28 22:19:21.111826 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: your server socket listen backlog is limited to 100 connections Jul 28 22:19:21.111826 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: your mercy for graceful operations on workers is 90 seconds Jul 28 22:19:21.112182 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 22:19:21.112266 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: *** Operational MODE: preforking *** Jul 28 22:19:21.112482 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: *** uWSGI is running in multiple interpreter mode *** Jul 28 22:19:21.112482 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: spawned uWSGI master process (pid: 103367) Jul 28 22:19:21.112665 dv-cinder-850939-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 22:19:21.113559 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: spawned uWSGI worker 1 (pid: 103368, cores: 1) Jul 28 22:19:21.113559 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: spawned uWSGI worker 2 (pid: 103369, cores: 1) Jul 28 22:19:21.113748 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 22:19:21.775612 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 22:19:21.777785 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 22:19:22.862200 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:19:22.862200 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: from cryptography.utils import int_from_bytes Jul 28 22:19:22.862818 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:19:22.862818 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: from cryptography.utils import int_from_bytes Jul 28 22:19:22.867483 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:19:22.867483 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: from cryptography.utils import int_from_bytes Jul 28 22:19:22.867915 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:19:22.867915 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: from cryptography.utils import int_from_bytes Jul 28 22:19:25.348246 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:19:25.348902 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:19:25.349024 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:19:25.349388 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:19:25.349670 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:19:25.350055 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:19:25.350456 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.350556 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:19:25.350640 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.350720 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.350798 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:19:25.350983 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.351152 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:19:25.351313 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.351410 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:19:25.351624 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.351766 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.351945 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352082 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352262 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352394 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352588 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352686 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.352848 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353011 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353163 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353312 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353486 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-3-iscsi {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353649 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353837 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.353959 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354146 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354278 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354461 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354574 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354781 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.354878 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355087 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355186 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-3-iscsi {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355410 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355506 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355714 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.355807 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.356015 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.356213 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.356325 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357344 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357439 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357519 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357626 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357704 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357771 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357771 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357896 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.357981 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.358060 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.358248 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.358337 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.358503 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.358698 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.359155 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.359433 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.359542 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.359833 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.359943 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.360154 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.360456 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.360636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.360865 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361010 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-3-iscsi {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361229 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361363 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361646 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-3-iscsi {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361764 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.361979 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362103 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362251 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362362 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362555 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362689 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.362960 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363044 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363266 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363357 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363571 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363656 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.363884 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364027 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364205 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364426 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364603 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364758 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.364906 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365092 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365227 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365401 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365580 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365697 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365784 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.365863 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366058 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366156 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366375 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366453 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366676 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366775 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.366977 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367073 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367229 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367323 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367536 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367623 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367787 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.367881 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368088 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368179 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368402 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368496 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368710 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368810 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.368962 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369056 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369255 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369352 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369501 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369655 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369840 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.369930 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.370156 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.370261 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.370455 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.370553 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.370795 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371055 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371152 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371360 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371455 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371662 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371756 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.371961 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372062 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372262 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372351 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372559 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372653 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372856 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.372953 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373169 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373257 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373477 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373618 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373818 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.373919 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.374120 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.374225 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.374494 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.374662 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.374837 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375065 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375154 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375314 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375616 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375774 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.375951 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376094 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376265 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376401 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376568 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376706 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.376880 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377011 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377195 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377331 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377497 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377671 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377823 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.377967 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378124 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378217 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378437 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378533 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378763 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.378858 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379062 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379156 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379309 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379397 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379602 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379691 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379902 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.379989 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380225 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380347 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380523 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380615 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380821 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.380907 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381119 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381209 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381498 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381734 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.381822 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391312 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391433 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391534 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391618 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391705 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391785 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391876 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.391963 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392043 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392121 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392207 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392300 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392381 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392460 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392545 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392631 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392711 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392798 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392886 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.392984 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393071 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393151 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393236 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393395 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393485 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393594 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393691 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393772 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393863 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.393944 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394031 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394118 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394207 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394294 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394381 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394469 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394550 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394628 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394706 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394785 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394864 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.394951 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395031 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395110 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395190 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395268 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395346 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395434 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395515 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395594 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395672 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395757 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395837 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.395928 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396009 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396088 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396173 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396253 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396340 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396428 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396509 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396587 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396673 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396753 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396839 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396920 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.396998 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397077 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397155 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397233 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397319 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397399 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397485 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397582 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397663 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397741 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397833 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.397914 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.397993 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.398072 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398156 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.398156 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:19:25.398316 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398316 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398472 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398560 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398641 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398727 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398808 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398893 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.398972 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399050 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399128 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399215 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399301 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399389 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399469 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399547 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399635 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399715 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399794 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399872 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.399977 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400092 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400197 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400197 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400353 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400442 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400519 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400616 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400710 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400800 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400882 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.400961 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401040 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401120 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401207 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401297 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401565 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401659 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401741 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401834 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.401927 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402017 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402105 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402186 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402272 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402360 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402449 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402531 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402610 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402690 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402770 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402862 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.402952 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403034 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403120 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403292 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403388 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403607 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403705 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.403912 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404001 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404262 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404358 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404520 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404617 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404837 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.404926 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.405160 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.405247 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.406181 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.406743 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.406743 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.406910 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.406910 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407071 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407220 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407320 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407553 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407640 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.407864 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408030 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408172 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408269 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408484 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408577 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408804 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.408901 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409113 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409199 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409420 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409507 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409757 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.409855 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410063 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410150 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410365 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410450 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410669 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410764 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.410967 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411053 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411266 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411353 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411569 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411699 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411874 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.411976 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412174 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412274 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412485 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412592 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412803 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.412900 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413103 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413207 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413411 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413507 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413740 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.413835 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414044 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414139 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414344 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414442 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414647 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414755 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.414947 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415053 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415252 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415350 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415555 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415661 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415853 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.415964 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416171 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416275 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416474 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416578 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416768 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.416872 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417080 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417183 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417379 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417476 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.417816 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418012 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418108 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418315 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418412 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418621 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418725 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.418924 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419029 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419228 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419326 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419548 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419693 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419852 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.419991 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420143 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420278 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420474 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420621 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420801 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.420931 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421143 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421242 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421449 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421668 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421839 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.421984 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422118 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422277 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422414 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422569 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422707 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.422874 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423012 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423159 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423295 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423458 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423598 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423758 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.423945 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424088 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424245 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424382 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424516 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424651 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424798 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.424943 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425078 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425220 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425355 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425489 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425666 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425803 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.425945 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426099 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426235 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426373 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426536 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426669 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426852 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.426990 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427191 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427329 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427512 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427652 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427836 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.427985 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428133 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428271 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428453 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428592 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.428903 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429073 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429214 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429382 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429518 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429711 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.429849 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430002 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430157 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430293 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430435 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430601 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430740 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.430920 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431067 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431226 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431365 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431538 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431693 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431872 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.431973 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432144 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432234 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432447 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432535 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432761 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.432860 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433060 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433148 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433367 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433462 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433723 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.433816 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434037 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434132 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434349 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434443 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434656 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434745 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.434957 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435044 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435265 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435353 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435565 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435654 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435867 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.435955 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.436167 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.436256 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.436469 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.436560 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.437299 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.437454 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.437616 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.437743 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.437916 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438007 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438219 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438307 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438534 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438632 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438839 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.438934 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439151 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439247 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439449 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439547 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439755 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.439890 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440075 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440207 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440401 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440532 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440705 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.440848 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441010 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441158 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441331 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441469 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441668 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.441799 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442104 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442272 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442570 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442717 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.442867 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443028 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443170 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443337 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443478 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443643 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443781 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.443965 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444129 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444261 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444371 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444564 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444677 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444868 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.444966 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445180 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445268 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445502 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445647 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445836 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.445926 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446159 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446257 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446462 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446559 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446772 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.446861 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447078 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447167 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447376 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447469 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447675 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447764 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.447984 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448078 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448378 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448584 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448673 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448881 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.448969 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449178 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449354 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449510 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449633 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449836 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.449923 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450134 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450231 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450444 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450532 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450757 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.450844 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451063 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451167 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451366 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451453 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451669 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451758 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.451970 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.452089 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.452283 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.452917 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453161 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453253 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453472 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453582 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453808 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.453897 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454121 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454210 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454441 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454530 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454744 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.454840 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455055 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455149 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455359 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455446 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455662 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455756 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.455965 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456060 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456263 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456363 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456564 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456838 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.456933 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.457173 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.457417 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.457505 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.457768 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.457856 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458075 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458174 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458386 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458475 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458697 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.458784 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459008 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459104 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459331 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459420 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459652 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459750 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.459958 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460046 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460263 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460368 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460560 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460647 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460858 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.460946 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461161 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461326 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461462 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461593 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461859 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.461947 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462157 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462258 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462454 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462545 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462755 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.462849 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463050 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463146 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463345 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463432 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463639 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463727 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.463937 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464027 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464244 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464330 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464537 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464623 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464839 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.464929 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465136 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465223 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465440 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465545 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465764 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.465853 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466061 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466163 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466356 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466445 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466650 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466741 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.466984 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467078 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467284 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467380 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467615 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467703 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.467954 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468046 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468278 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468369 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468606 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468705 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.468912 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469001 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469217 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469313 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469513 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469669 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469835 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.469924 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470132 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470229 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470434 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470520 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470732 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.470819 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471032 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471121 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471334 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471422 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471635 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471722 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.471936 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472025 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472236 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472378 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472531 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472622 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472832 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.472921 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473126 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473213 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473425 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473512 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473751 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.473841 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474051 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474140 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474346 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474442 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474648 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474734 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.474944 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475031 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475239 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475336 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475540 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475634 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475836 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.475925 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476139 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476235 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476431 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476517 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476726 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.476820 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477022 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477123 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477321 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477407 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477640 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477743 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.477936 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478026 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478252 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478342 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478552 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478639 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478845 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.478933 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479139 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479226 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479439 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479527 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479734 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.479824 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480029 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480116 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480328 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480416 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480641 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480738 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.480947 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481034 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481240 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481336 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481591 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481782 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481871 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.481952 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482136 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482246 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482434 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482538 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482735 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.482839 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483029 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483131 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483324 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483412 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483640 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483732 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.483970 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484095 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484278 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484371 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484583 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484672 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484882 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.484976 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485176 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485263 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485473 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485583 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485803 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.485893 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486136 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486223 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486432 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486527 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.486859 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487069 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487155 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487375 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487464 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487684 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487779 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.487985 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488071 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488286 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488385 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488589 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488683 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488885 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.488973 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489193 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489355 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489494 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489627 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489822 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.489914 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490117 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490214 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490414 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490502 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490734 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.490821 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491039 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491135 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491342 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491430 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491655 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491752 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.491961 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492061 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492269 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492357 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492564 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492713 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492863 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.492954 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493164 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493252 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493462 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493571 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493791 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.493882 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494091 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494179 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494392 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494480 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494695 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494784 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.494996 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495085 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495298 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495385 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495599 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495687 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495898 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.495986 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496199 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496299 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496499 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496586 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496798 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.496886 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497104 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497204 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497405 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497499 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497730 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.497829 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498031 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498131 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498331 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498418 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498632 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498759 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.498929 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.499068 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.499947 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500050 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500258 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500384 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500569 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500666 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500870 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.500981 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501176 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501298 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501480 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501675 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501814 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.501947 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.502123 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.502372 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.502478 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.502701 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.502822 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503002 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503107 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503311 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503415 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503615 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503705 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.503919 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504006 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504228 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504324 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504542 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504629 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504846 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.504975 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.505144 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.505233 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.505519 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.505860 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.506165 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.506488 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.506907 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.507219 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.507526 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.507940 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.508251 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.508560 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.508883 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.509205 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.509544 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.509847 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.510160 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.510473 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.510797 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.510884 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.511386 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.511549 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.511696 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.511908 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512006 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512239 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512376 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512579 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512709 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.512916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513028 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513228 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513319 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513573 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513667 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.513992 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514081 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514316 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514407 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514626 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514726 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.514980 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515122 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515307 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515638 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515881 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.515990 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.516690 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.516838 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517006 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517210 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517307 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517611 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517720 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.517950 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518040 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518258 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518347 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518569 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518671 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518878 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.518968 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519187 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519278 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519491 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519590 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519794 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.519882 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520115 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520204 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520419 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520637 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520747 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.520972 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521062 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521294 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521393 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521649 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521742 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.521987 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522085 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522301 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522419 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522609 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522718 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.522914 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523014 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523217 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523317 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523517 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523645 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523844 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.523934 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524156 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524254 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524474 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524563 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524795 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.524945 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525109 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525202 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525419 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525517 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525760 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.525849 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526092 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526184 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526399 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526489 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526728 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.526828 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527045 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527350 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527437 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527656 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527755 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.527965 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528055 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528269 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528358 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528571 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528673 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528875 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.528970 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529179 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529275 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529480 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529631 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529805 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.529903 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.530110 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.530205 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.530466 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.530559 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.530901 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531007 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531243 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531341 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531561 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531651 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.531906 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532022 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532236 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532335 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532542 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532633 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532866 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.532968 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533183 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533296 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533497 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533655 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533831 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.533931 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534145 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534244 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534455 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534545 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534762 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.534852 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535069 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535170 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535381 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535470 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535690 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535786 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.535998 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536096 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536311 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536399 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536641 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536770 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.536933 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537045 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537247 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537351 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537575 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537668 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537885 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.537975 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.538191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.538280 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.538496 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.538585 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.538841 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539024 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539147 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539354 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539482 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539668 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539800 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.539981 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.540125 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.540293 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.540456 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.540694 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.540862 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541016 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541105 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541328 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541416 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541754 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.541974 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542120 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542285 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542376 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542612 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542709 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.542933 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543022 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543252 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543352 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543562 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543652 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543877 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.543966 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.544188 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.544284 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.544501 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.544592 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.544815 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545038 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545174 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545370 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545488 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545715 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.545807 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546051 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546472 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546579 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546814 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.546928 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547117 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547231 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547433 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547525 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547750 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.547848 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548060 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548226 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548371 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548459 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548676 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548764 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.548990 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549088 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549304 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549463 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549653 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549747 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.549986 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550083 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550303 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550391 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550616 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550713 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.550928 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551018 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551244 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551333 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551590 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.551903 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552080 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552221 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552416 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552542 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552742 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.552861 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553068 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553179 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553387 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553497 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553733 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.553834 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554060 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554150 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554367 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554463 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554674 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554764 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.554985 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555073 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555294 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555391 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555598 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555687 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.555921 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556010 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556233 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556331 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556541 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556629 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556861 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.556950 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.557172 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.557278 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.557724 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.557839 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558048 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558145 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558379 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558468 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558706 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.558795 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559033 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559129 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559348 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559443 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559656 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559744 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.559980 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560069 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560287 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560375 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560594 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560692 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560908 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.560995 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.561217 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.561306 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.561520 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.561633 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.562474 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.562877 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.562967 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563139 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563221 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563302 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563391 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563609 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563718 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.563982 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564138 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564309 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564493 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564617 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564815 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.564926 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565145 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565233 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565474 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565584 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565822 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.565910 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566136 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566237 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566443 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566532 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566749 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.566837 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567055 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567191 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567359 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567455 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567668 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567757 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.567972 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568069 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568281 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568368 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568587 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568687 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568894 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.568994 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569199 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569285 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569512 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569639 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569843 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.569933 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570164 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570258 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570470 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570558 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570777 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.570876 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571086 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571174 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571398 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571486 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571704 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.571793 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572010 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572106 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572319 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572407 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572626 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572862 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.572951 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573198 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573287 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573542 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573647 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573853 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.573994 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574168 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574259 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574475 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574566 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574782 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.574870 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575090 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575186 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575414 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575513 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575727 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.575817 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576038 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576127 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576348 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576437 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576656 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576743 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.576962 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.577059 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.577274 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.577416 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.578537 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.578638 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.578722 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.578879 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.578975 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579065 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579189 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579499 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579587 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579808 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.579900 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580117 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580213 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580427 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580548 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580743 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.580882 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581090 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581185 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581408 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581506 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581749 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.581839 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582068 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582165 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582384 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582481 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582693 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.582782 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583005 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583104 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583314 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583416 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583622 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583716 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.583931 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584079 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584241 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584332 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584553 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584641 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584854 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.584941 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585161 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585276 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585469 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585628 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585806 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.585922 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586122 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586245 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586434 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586554 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.586877 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587096 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587192 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587415 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587504 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587732 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.587830 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588047 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588137 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588364 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588453 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588674 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588775 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.588985 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589073 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589295 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589382 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589680 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589783 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.589989 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590078 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590294 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590383 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590605 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590694 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.590918 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591013 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591225 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591340 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591528 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591655 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591832 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.591973 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592141 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592295 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592446 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592603 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592751 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.592963 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.593117 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.593669 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.593820 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.593917 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594062 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594192 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594279 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594375 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594459 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594572 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594750 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.594874 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595093 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595191 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595426 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595522 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595756 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.595846 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596055 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596144 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596360 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596449 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596758 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.596965 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597063 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597268 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597363 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597602 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597695 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.597912 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598003 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598219 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598317 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598534 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598622 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598842 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.598940 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599150 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599240 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599550 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599757 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.599844 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600064 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600152 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600369 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600472 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600674 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600762 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.600976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601063 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601279 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601381 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601607 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601702 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.601915 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602003 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602221 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602326 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602524 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602612 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602830 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.602918 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603133 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603229 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603436 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603524 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603739 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.603864 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604069 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604208 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604389 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604479 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604702 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.604797 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605016 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605112 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605324 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605412 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605672 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605777 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.605982 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606071 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606293 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606381 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606603 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.606914 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607012 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607220 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607308 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607530 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607745 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607834 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.607915 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.608135 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.608232 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.608441 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.608555 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.608808 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609298 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609373 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609455 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609598 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609686 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609814 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.609903 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610011 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610155 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610320 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610486 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610646 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610841 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.610963 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611154 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611284 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611500 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611595 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611832 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.611927 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612148 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612238 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612462 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612551 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612768 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.612855 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.613014 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:19:25.613114 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.613395 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.613729 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.614047 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.614360 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.614672 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.614989 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.615303 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.615633 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.615959 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.616275 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.616602 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.616930 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.617277 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.617613 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.617958 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.618289 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.618603 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.618917 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.619223 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:19:25.619467 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:19:25.766937 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Registered counter for database nova_api Jul 28 22:19:25.773836 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Registered counter for database nova_api Jul 28 22:19:25.787401 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.794134 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.796020 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:25.801654 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:25.853798 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.context [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39a213b2-8d6f-4b22-9f78-f4ccc3b99c66(cell1) {{(pid=103368) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 22:19:25.857335 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.context [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39a213b2-8d6f-4b22-9f78-f4ccc3b99c66(cell1) {{(pid=103369) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 22:19:25.857775 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:19:25.859614 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:19:25.860406 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:19:25.861465 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:19:25.862437 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:19:25.863082 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:19:25.863883 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:19:25.864403 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Registered counter for database nova_cell0 Jul 28 22:19:25.865888 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:19:25.867854 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Registered counter for database nova_cell0 Jul 28 22:19:25.869814 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Registered counter for database nova_cell1 Jul 28 22:19:25.873220 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Registered counter for database nova_cell1 Jul 28 22:19:25.878438 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.879231 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.882454 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.884693 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:25.886409 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:25.887908 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:25.889501 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:26.027209 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:26.033074 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Registered counter for database nova_cell0 Jul 28 22:19:26.037699 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Registered counter for database nova_cell0 Jul 28 22:19:26.042246 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:26.044141 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:19:26.046831 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:26.049282 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:19:26.387276 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:19:26.388171 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:19:26.395421 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:19:26.395917 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:19:26.736719 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:19:26.737218 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:19:26.742642 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:19:26.743234 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:19:26.747861 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561bf7fd39c0 pid: 103368 (default app) Jul 28 22:19:26.748441 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561bf7fd39c0 pid: 103369 (default app) Jul 28 22:19:26.750522 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:19:26.751712 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-1fe786fa-b7f0-49ce-815b-4098e6c3cc8e None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002336 Jul 28 22:19:26.752115 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Thu Jul 28 22:19:26 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:42.726342 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:42.727563 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jul 28 22:20:42.728115 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:42.739528 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:42.740641 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell0:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:42.741647 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell1:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:42.742728 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:43.623341 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-98119020-76fd-4dbb-9f83-b026ef3d5705 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:43.659565 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-98119020-76fd-4dbb-9f83-b026ef3d5705 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925315 Jul 28 22:20:43.660445 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jul 28 22:20:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:20:45.890596 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:45.891638 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-41b7b71a-08e2-4f2e-871a-01504fcd37a0 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 28 22:20:45.892255 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:46.361939 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-0fa6519a-9b1c-4fa6-b07c-1f780a1dc61e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:46.381419 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:20:46.381419 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jul 28 22:20:46.411314 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-0fa6519a-9b1c-4fa6-b07c-1f780a1dc61e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513003 Jul 28 22:20:46.412240 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:20:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:20:46.425438 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:46.426660 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell0:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:46.428092 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell1:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:46.428955 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:46.641157 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6fae3aa9-850b-4135-8b01-0158704536ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:46.645513 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:20:46.645513 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:20:46.709322 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6fae3aa9-850b-4135-8b01-0158704536ff admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289247 Jul 28 22:20:46.710112 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jul 28 22:20:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:20:48.948898 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-0fa6519a-9b1c-4fa6-b07c-1f780a1dc61e admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:48.950157 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-0fa6519a-9b1c-4fa6-b07c-1f780a1dc61e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 28 22:20:48.950815 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:49.618060 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2b329f9c-7546-4923-960e-4e1f6526b36e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:49.637358 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:20:49.637358 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:20:49.657811 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2b329f9c-7546-4923-960e-4e1f6526b36e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699762 Jul 28 22:20:49.665330 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:20:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:20:49.677218 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-c42dfb2a-4357-4d49-b725-4617835d25d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:49.680144 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:20:49.680144 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jul 28 22:20:49.713290 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-c42dfb2a-4357-4d49-b725-4617835d25d0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039814 Jul 28 22:20:49.714240 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jul 28 22:20:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:20:51.997188 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2b329f9c-7546-4923-960e-4e1f6526b36e admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:51.997188 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2b329f9c-7546-4923-960e-4e1f6526b36e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 28 22:20:51.997188 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:52.343117 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-3ba800f4-c48c-4ede-9e28-ad5bcbc7f93c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:52.363560 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-3ba800f4-c48c-4ede-9e28-ad5bcbc7f93c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.361953 Jul 28 22:20:52.364105 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:20:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:20:52.376096 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-cd04a12b-6aa1-4d18-8dc1-90a1b8975fa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:52.399584 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-cd04a12b-6aa1-4d18-8dc1-90a1b8975fa8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027255 Jul 28 22:20:52.400242 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jul 28 22:20:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:20:54.609022 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-3ba800f4-c48c-4ede-9e28-ad5bcbc7f93c admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:54.610059 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-3ba800f4-c48c-4ede-9e28-ad5bcbc7f93c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 28 22:20:54.610465 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:55.043851 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-cf5cdfd9-e0aa-433f-9534-a433776eef14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:55.063950 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-cf5cdfd9-e0aa-433f-9534-a433776eef14 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447541 Jul 28 22:20:55.064594 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:20:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:20:55.076514 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-fd572515-9603-4814-8313-4b96924825ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:55.100309 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-fd572515-9603-4814-8313-4b96924825ea admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027547 Jul 28 22:20:55.100874 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jul 28 22:20:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:20:57.355098 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-cf5cdfd9-e0aa-433f-9534-a433776eef14 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:20:57.356095 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-cf5cdfd9-e0aa-433f-9534-a433776eef14 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 28 22:20:57.356488 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:20:57.781208 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "disk": 20, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:57.802145 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439616 Jul 28 22:20:57.802918 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:20:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:20:57.816683 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-f9828c17-a561-4362-bbd9-22f21cf18d1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:20:57.845108 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-f9828c17-a561-4362-bbd9-22f21cf18d1a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033164 Jul 28 22:20:57.846051 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1335 bytes} [Thu Jul 28 22:20:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:21:00.085147 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:00.086779 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Jul 28 22:21:00.087543 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:00.517067 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-1403c4b3-42fe-40e1-a6dc-282ca32932df admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:00.541455 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-1403c4b3-42fe-40e1-a6dc-282ca32932df admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448108 Jul 28 22:21:00.542330 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jul 28 22:21:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:02.785389 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:02.786445 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-70161501-33b8-4935-80f7-4951128b58d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 28 22:21:02.786845 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:03.242505 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-0d064277-c036-4afd-a992-08b583a0c6bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:03.262331 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-0d064277-c036-4afd-a992-08b583a0c6bc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469225 Jul 28 22:21:03.262803 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:21:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:03.278117 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-900c903d-7212-4936-822c-1fcd8498679e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:03.303632 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-900c903d-7212-4936-822c-1fcd8498679e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029324 Jul 28 22:21:03.304210 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jul 28 22:21:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:21:05.638080 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-0d064277-c036-4afd-a992-08b583a0c6bc admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:05.639305 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-0d064277-c036-4afd-a992-08b583a0c6bc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Jul 28 22:21:05.639797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:06.098917 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-e3dfab6b-9e21-4ed5-adce-9e74a5cf898f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:06.133924 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-e3dfab6b-9e21-4ed5-adce-9e74a5cf898f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488076 Jul 28 22:21:06.134473 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:21:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:06.147654 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-736b7f6c-e0f9-4925-80e2-ca354b8070cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:06.176294 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-736b7f6c-e0f9-4925-80e2-ca354b8070cd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032903 Jul 28 22:21:06.176867 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jul 28 22:21:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:21:08.417709 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-e3dfab6b-9e21-4ed5-adce-9e74a5cf898f admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:08.418704 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-e3dfab6b-9e21-4ed5-adce-9e74a5cf898f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 28 22:21:08.419104 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:08.827610 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-124abfa7-83e2-4b4b-a114-b9f1eec03605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "id": "3", "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:08.846777 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-124abfa7-83e2-4b4b-a114-b9f1eec03605 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420406 Jul 28 22:21:08.847514 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:21:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:21:08.859772 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-de40e165-97e5-4acb-85e3-f9bb209be0ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:08.883835 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-de40e165-97e5-4acb-85e3-f9bb209be0ee admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028344 Jul 28 22:21:08.884581 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jul 28 22:21:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:21:11.132226 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-124abfa7-83e2-4b4b-a114-b9f1eec03605 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:11.134087 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-124abfa7-83e2-4b4b-a114-b9f1eec03605 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Jul 28 22:21:11.134966 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:11.585665 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7adfaff9-badd-4f53-90cf-3aeea3981936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:11.606620 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7adfaff9-badd-4f53-90cf-3aeea3981936 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465751 Jul 28 22:21:11.607681 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:21:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:11.619748 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-e5802540-9c2e-447a-93ae-130d11fe7a40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:11.648922 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-e5802540-9c2e-447a-93ae-130d11fe7a40 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032659 Jul 28 22:21:11.650124 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jul 28 22:21:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:21:13.873478 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7adfaff9-badd-4f53-90cf-3aeea3981936 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:13.874569 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7adfaff9-badd-4f53-90cf-3aeea3981936 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jul 28 22:21:13.874972 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:14.353512 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:14.377401 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496657 Jul 28 22:21:14.378245 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1282 bytes} [Thu Jul 28 22:21:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:21:14.391099 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-5c9b0d2f-761b-4963-9f25-b009f7bd40e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:14.396043 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:14.418639 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-5c9b0d2f-761b-4963-9f25-b009f7bd40e3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031919 Jul 28 22:21:14.426609 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1332 bytes} [Thu Jul 28 22:21:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:21:34.505135 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:34.506170 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 28 22:21:34.506575 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:34.893252 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-5d7a1aed-1c8b-4b36-97d8-91c58aa655f8 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:34.911667 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-5d7a1aed-1c8b-4b36-97d8-91c58aa655f8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399313 Jul 28 22:21:34.912197 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jul 28 22:21:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:21:35.977669 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:35.978672 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-92e2e4a2-4ec1-4402-958c-fd4e4716b563 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 28 22:21:35.979070 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:36.500704 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-05589756-b700-4ee5-b295-a001d1e2e653 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:36.506484 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-05589756-b700-4ee5-b295-a001d1e2e653 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-05589756-b700-4ee5-b295-a001d1e2e653 admin admin] Request method failure captured: Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept: application/json Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Host: 10.222.0.39 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABi4wvv2nufEIrOB0Yp3FsUykP_EYT7LZhAKDgiOxDhD6nmJVoD2rEwoZ_WpYmjU7cT8-gvzaMfL0HiqK2MTd2PjRpQF6II_C_Xp0YY_3SMNH-Lg8nTXl4w6vDzftBarXV1sfEwthuyHZDgl-XqSe3-eq7r7QvzxUyg8ugoHD7SYFjZt5E Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jul 28 22:21:36.509731 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User: admin Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: method: > Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: exception: Flavor 42 could not be found. Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: action_args: {'id': '42'} Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:36.511400 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:36.512763 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.514049 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-05589756-b700-4ee5-b295-a001d1e2e653 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:36.515159 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-05589756-b700-4ee5-b295-a001d1e2e653 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391036 Jul 28 22:21:36.515159 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jul 28 22:21:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:36.520983 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-4a1295b8-16f1-4e80-a8e0-4efb1981432e admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:36.525284 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:36.545240 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-4a1295b8-16f1-4e80-a8e0-4efb1981432e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027703 Jul 28 22:21:36.545815 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:36.555391 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-2734a005-7f05-4772-ba79-b37513b5e020 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:36.579931 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-2734a005-7f05-4772-ba79-b37513b5e020 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028036 Jul 28 22:21:36.580466 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:36.594326 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-edb152fd-f889-4863-9ff6-a3199c6c8b4b admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:36.600972 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-edb152fd-f889-4863-9ff6-a3199c6c8b4b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-edb152fd-f889-4863-9ff6-a3199c6c8b4b admin admin] Request method failure captured: Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept: application/json Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Host: 10.222.0.39 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABi4wvv2nufEIrOB0Yp3FsUykP_EYT7LZhAKDgiOxDhD6nmJVoD2rEwoZ_WpYmjU7cT8-gvzaMfL0HiqK2MTd2PjRpQF6II_C_Xp0YY_3SMNH-Lg8nTXl4w6vDzftBarXV1sfEwthuyHZDgl-XqSe3-eq7r7QvzxUyg8ugoHD7SYFjZt5E Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jul 28 22:21:36.604270 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User: admin Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: method: > Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: exception: Flavor 42 could not be found. Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: action_args: {'id': '42'} Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:36.605752 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:36.607412 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:36.608797 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-edb152fd-f889-4863-9ff6-a3199c6c8b4b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:36.610053 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-edb152fd-f889-4863-9ff6-a3199c6c8b4b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015107 Jul 28 22:21:36.610053 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jul 28 22:21:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:37.580052 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-2734a005-7f05-4772-ba79-b37513b5e020 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:37.581087 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-2734a005-7f05-4772-ba79-b37513b5e020 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 28 22:21:37.581485 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:38.106924 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-21e9f234-fccb-4722-8244-5739908040aa admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:38.112180 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-21e9f234-fccb-4722-8244-5739908040aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-21e9f234-fccb-4722-8244-5739908040aa admin admin] Request method failure captured: Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept: application/json Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Host: 10.222.0.39 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABi4wvxIU8ZFZLZ3bDqftAtjDKDmmEnFFoi9pUxFDD_uOd6yez0IhlHwZVtCD6SxJmYAlKfpNqXqrTAdpssLD_jeCmoFIQj9NaR9GJUhQbUm6XiFQMUBqL6bID11XJS72rYwA5mVfTMuYxcM8LxYfxiDoUZM3jeKXCB8A4ponlBe11oxeU Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jul 28 22:21:38.113685 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User: admin Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: method: > Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: exception: Flavor 84 could not be found. Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: action_args: {'id': '84'} Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:38.115191 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:38.116193 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.117701 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-21e9f234-fccb-4722-8244-5739908040aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:38.118921 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-21e9f234-fccb-4722-8244-5739908040aa admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393416 Jul 28 22:21:38.118921 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jul 28 22:21:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:38.125235 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-77eab890-75d6-421a-9f1b-8e76ba4eb6b5 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:38.141333 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-77eab890-75d6-421a-9f1b-8e76ba4eb6b5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020232 Jul 28 22:21:38.141941 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:38.151646 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-89908d10-fead-4279-8e9b-354ad2f0c114 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:38.167249 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-89908d10-fead-4279-8e9b-354ad2f0c114 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019143 Jul 28 22:21:38.167777 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:21:38.177281 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-d89dab01-c5ea-4000-85cc-5b4a4eef9683 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:38.182650 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-d89dab01-c5ea-4000-85cc-5b4a4eef9683 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-d89dab01-c5ea-4000-85cc-5b4a4eef9683 admin admin] Request method failure captured: Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept: application/json Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Host: 10.222.0.39 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABi4wvxIU8ZFZLZ3bDqftAtjDKDmmEnFFoi9pUxFDD_uOd6yez0IhlHwZVtCD6SxJmYAlKfpNqXqrTAdpssLD_jeCmoFIQj9NaR9GJUhQbUm6XiFQMUBqL6bID11XJS72rYwA5mVfTMuYxcM8LxYfxiDoUZM3jeKXCB8A4ponlBe11oxeU Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jul 28 22:21:38.184132 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User: admin Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: method: > Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: exception: Flavor 84 could not be found. Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: action_args: {'id': '84'} Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:38.186167 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:38.187171 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:38.188454 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-d89dab01-c5ea-4000-85cc-5b4a4eef9683 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:38.189802 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-d89dab01-c5ea-4000-85cc-5b4a4eef9683 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012983 Jul 28 22:21:38.189802 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Jul 28 22:21:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:39.148258 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-89908d10-fead-4279-8e9b-354ad2f0c114 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:39.149290 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-89908d10-fead-4279-8e9b-354ad2f0c114 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 28 22:21:39.149713 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:21:39.677627 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-03deefe8-1d2d-432b-b9f4-d0600ff893ac admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:39.683278 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-03deefe8-1d2d-432b-b9f4-d0600ff893ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-03deefe8-1d2d-432b-b9f4-d0600ff893ac admin admin] Request method failure captured: Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept: application/json Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Host: 10.222.0.39 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABi4wvzEz439nTWN4yTGCgI88PqWo6jhVpqAf4_GNL6mAV2naMqueAeRXzfxi7w2pyLInOBB7xxfhMIRafSTGS73VYvqFcDeMhZQ3GzWJZj9oXCa-khEyDnMvA_RHWsI5lSuwtBOPp5gfAIttpS8LVNMkXJOg5H1f2UEEpgFR-NHCSWNp4 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jul 28 22:21:39.685916 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User: admin Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: method: > Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: exception: Flavor 451 could not be found. Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: action_args: {'id': '451'} Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:39.687636 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:39.688662 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.690124 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-03deefe8-1d2d-432b-b9f4-d0600ff893ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:39.691435 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-03deefe8-1d2d-432b-b9f4-d0600ff893ac admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395273 Jul 28 22:21:39.691435 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:21:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:39.696773 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-fe9e2df4-9603-43a0-8216-e67621f62c63 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:39.712071 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-fe9e2df4-9603-43a0-8216-e67621f62c63 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018780 Jul 28 22:21:39.712591 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:39.726042 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:39.740804 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018347 Jul 28 22:21:39.741324 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Jul 28 22:21:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:21:39.750716 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-af4f494e-a904-4de2-9b69-8563524965bc admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:39.755850 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-af4f494e-a904-4de2-9b69-8563524965bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-af4f494e-a904-4de2-9b69-8563524965bc admin admin] Request method failure captured: Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept: application/json Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Host: 10.222.0.39 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABi4wvzEz439nTWN4yTGCgI88PqWo6jhVpqAf4_GNL6mAV2naMqueAeRXzfxi7w2pyLInOBB7xxfhMIRafSTGS73VYvqFcDeMhZQ3GzWJZj9oXCa-khEyDnMvA_RHWsI5lSuwtBOPp5gfAIttpS8LVNMkXJOg5H1f2UEEpgFR-NHCSWNp4 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jul 28 22:21:39.757311 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26d9130b7556481bb766f1b06a63e1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Id: 26d9130b7556481bb766f1b06a63e1e5 Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User: admin Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Id: 0b20c2888f9642efb7858178880ed9a0 Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: method: > Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: exception: Flavor 451 could not be found. Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: action_args: {'id': '451'} Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:21:39.759004 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:39.759976 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jul 28 22:21:39.761285 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-af4f494e-a904-4de2-9b69-8563524965bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:21:39.763052 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-af4f494e-a904-4de2-9b69-8563524965bc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012017 Jul 28 22:21:39.763052 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:21:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:40.733425 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:40.734446 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 28 22:21:40.734864 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:41.256349 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-a52117e5-125b-419a-a7ea-8ca3405e3a78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:41.275177 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-a52117e5-125b-419a-a7ea-8ca3405e3a78 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402202 Jul 28 22:21:41.275719 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jul 28 22:21:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:42.264233 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:42.265265 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 28 22:21:42.265696 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:42.787064 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-61002bb1-4947-4171-898c-0eb46b91da9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:42.805838 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-61002bb1-4947-4171-898c-0eb46b91da9d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403546 Jul 28 22:21:42.806408 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jul 28 22:21:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:43.778834 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:43.779833 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 28 22:21:43.780236 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:44.309373 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-deee44f5-593b-42ee-919d-961a2da324aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:44.327466 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-deee44f5-593b-42ee-919d-961a2da324aa admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409646 Jul 28 22:21:44.327999 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jul 28 22:21:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:21:45.312140 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:45.313196 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 22:21:45.313620 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:45.838078 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-f7585cfa-aaba-4687-a76e-cde8a02433e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:21:45.857383 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-f7585cfa-aaba-4687-a76e-cde8a02433e2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401653 Jul 28 22:21:45.857973 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Jul 28 22:21:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:21:46.826032 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:46.827039 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002414 Jul 28 22:21:46.827439 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:21:47.361178 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-a0e44b18-665b-447b-ada1-f283fa52db8a admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:21:47.381929 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-a0e44b18-665b-447b-ada1-f283fa52db8a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412942 Jul 28 22:21:47.382484 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Thu Jul 28 22:21:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:22:38.967173 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:38.968179 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-7362f2a5-74d8-4d42-9cfd-ed428cd02ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 28 22:22:38.968577 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 930 bytes} [Thu Jul 28 22:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:22:38.978637 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:39.356145 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3bed5a56-b4c7-4b4e-b768-ab72a25957b4 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:39.377463 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-3bed5a56-b4c7-4b4e-b768-ab72a25957b4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403195 Jul 28 22:22:39.378034 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1291 bytes} [Thu Jul 28 22:22:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:22:39.401225 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-00cf394a-4571-4a20-9076-4d2ffbc78df7 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:39.404677 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:39.410483 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-00cf394a-4571-4a20-9076-4d2ffbc78df7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012882 Jul 28 22:22:39.411012 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1282 bytes} [Thu Jul 28 22:22:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:22:39.423458 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-d21c517f-fda9-4dfd-b4fc-523fe908d5e8 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:39.431320 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-d21c517f-fda9-4dfd-b4fc-523fe908d5e8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012482 Jul 28 22:22:39.431831 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1285 bytes} [Thu Jul 28 22:22:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:22:39.443980 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:39.452337 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012150 Jul 28 22:22:39.452857 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1285 bytes} [Thu Jul 28 22:22:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:22:39.463925 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-cf506717-29f9-4a8b-85e4-00351d683d5e admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:22:39.471815 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-cf506717-29f9-4a8b-85e4-00351d683d5e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011427 Jul 28 22:22:39.472324 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1282 bytes} [Thu Jul 28 22:22:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:26:00.404389 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:00.405479 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 28 22:26:00.405862 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:26:00.544553 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=6 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:00.704588 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:00.706946 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:26:00.706946 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:26:00.708184 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:00.708658 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:00.709445 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:00.709902 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:00.743827 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-a6311b02-8495-460d-9fed-98549b5b6c0b admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200634 Jul 28 22:26:00.744408 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:26:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:26:01.592120 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:01.593122 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 28 22:26:01.593539 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:26:01.788126 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:01.791147 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:26:01.791147 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:26:01.792327 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:01.792769 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:01.793622 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:01.794049 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:01.813899 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-13789a5d-1128-4c09-b5da-bc29ecc06210 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077357 Jul 28 22:26:01.814380 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:26:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:26:13.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:13.067404 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 28 22:26:13.067803 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:26:13.241088 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell0:SELECT=4 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:13.241088 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell1:SELECT=4 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:13.243996 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=8 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:13.298355 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:13.300784 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:26:13.300784 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:26:13.302670 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:13.302670 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:13.303855 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:13.304310 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:13.332105 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-3c372f34-d054-4026-b495-200cb759f5b5 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095787 Jul 28 22:26:13.332675 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:26:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:26:14.172762 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:14.173792 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-b6f46a1c-22b6-4ea5-a3b5-2833647bca86 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 28 22:26:14.174186 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Jul 28 22:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:26:14.368057 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:26:14.370433 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:26:14.370433 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jul 28 22:26:14.371602 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:14.372041 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:14.372809 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:26:14.373228 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:26:14.394416 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-d3602753-04e3-4003-a49b-2285c0092698 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078774 Jul 28 22:26:14.394901 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Jul 28 22:26:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:27:11.970940 dv-cinder-850939-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 22:27:11.971469 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: Thu Jul 28 22:27:11 2022 - graceful shutdown triggered... Jul 28 22:27:11.971925 dv-cinder-850939-3-iscsi devstack@n-api.service[103368]: Gracefully killing worker 1 (pid: 103368)... Jul 28 22:27:11.972309 dv-cinder-850939-3-iscsi devstack@n-api.service[103369]: Gracefully killing worker 2 (pid: 103369)... Jul 28 22:27:12.972392 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: worker 1 buried after 1 seconds Jul 28 22:27:12.972864 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: worker 2 buried after 1 seconds Jul 28 22:27:12.972864 dv-cinder-850939-3-iscsi devstack@n-api.service[103367]: goodbye to uWSGI. Jul 28 22:27:12.974069 dv-cinder-850939-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 22:27:12.974633 dv-cinder-850939-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 22:27:12.977354 dv-cinder-850939-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 22:27:12.988342 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 22:27:12 2022] *** Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: nodename: dv-cinder-850939-3-iscsi Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: machine: x86_64 Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: clock source: unix Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: pcre jit disabled Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: detected number of CPU cores: 4 Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: current working directory: / Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: detected binary path: /usr/bin/uwsgi-core Jul 28 22:27:12.990433 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: your processes number limit is 47680 Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: your memory page size is 4096 bytes Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: detected max file descriptor number: 2048 Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: lock engine: pthread robust mutexes Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: thunder lock: enabled Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 22:27:12.991286 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: Python main interpreter initialized at 0x55fdc4bc39c0 Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: python threads support enabled Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: your server socket listen backlog is limited to 100 connections Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: your mercy for graceful operations on workers is 90 seconds Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: *** Operational MODE: preforking *** Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: *** uWSGI is running in multiple interpreter mode *** Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: spawned uWSGI master process (pid: 118071) Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: spawned uWSGI worker 1 (pid: 118085, cores: 1) Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: spawned uWSGI worker 2 (pid: 118086, cores: 1) Jul 28 22:27:13.034370 dv-cinder-850939-3-iscsi devstack@n-api.service[118071]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 22:27:13.032339 dv-cinder-850939-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 22:27:13.696341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 22:27:13.747941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 22:27:14.885961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:27:14.885961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: from cryptography.utils import int_from_bytes Jul 28 22:27:14.887088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:27:14.887088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: from cryptography.utils import int_from_bytes Jul 28 22:27:14.948707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:27:14.948707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: from cryptography.utils import int_from_bytes Jul 28 22:27:14.949301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:27:14.949301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: from cryptography.utils import int_from_bytes Jul 28 22:27:17.308863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:27:17.309879 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:27:17.310435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:27:17.310815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:27:17.311083 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:27:17.311492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.311837 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.312174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.312506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.312851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.313173 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.313508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.313865 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.314206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.314478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.314806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.315320 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-3-iscsi {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.315487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.315785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.316117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.316446 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.316767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.317097 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.317413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.317963 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.320877 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.321073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.321362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.321748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.322075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.322492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-3-iscsi {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.322824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.323154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.323481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.323929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.324237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.324559 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.324887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.325228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.325562 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.325902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.326227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.326555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.326896 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.327217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.327519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.327839 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.328172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.328469 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:27:17.328936 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.329024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:27:17.329107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.329107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.329246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:27:17.329343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.329650 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:27:17.329824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.329978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:27:17.330163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.330356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.330518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.330682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.330835 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.330991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331313 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.331924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332092 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332265 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332605 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.332934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.333098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.333253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.333412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.333709 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.333861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-3-iscsi {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.334922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.335084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.335340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.335519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.335667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.335819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336170 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336344 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.336818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.337133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.337317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.337474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.337643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.338649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.338816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.338970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339417 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.339866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.340774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341348 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-3-iscsi {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.341844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342007 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.342923 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343068 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343667 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343822 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.343977 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.344128 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.344281 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.345181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.345341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.345497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.345886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346400 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.346875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347354 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347507 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347660 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.347969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.348875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.349032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.349953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.350108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.350253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.350424 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351061 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.351993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352579 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.352896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.353866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354024 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354781 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.354927 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355529 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.355834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356651 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.356954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357249 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357737 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.357894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.358038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.358189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359656 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.359808 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360082 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360244 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.360851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.361006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.361151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.361305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.361305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.361626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.361784 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.361939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.362085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.362229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.362373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.362524 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.362680 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.362832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.362982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.363126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.363288 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.363433 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.363587 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.363741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.363885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.364035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.364189 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.364340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.364494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.364639 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.364792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.364943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.365095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.365095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.365404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.365631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.365785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.365941 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.366096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.366916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.367077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.367231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.367384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.367529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.367681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.367911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.368070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.368216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.368360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.369099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.369269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.369426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.369603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.369775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.369931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.370096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.370096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.370481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.370636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.370801 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.370957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.371110 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.371255 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.371407 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.371551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.371702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.371856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.372008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.372162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.372307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.372307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.372608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.372762 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.372914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.373065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.373210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.373361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.373515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.373723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.373868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.374011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.374166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.374317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.374476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.374476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.374784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.374894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.374984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.375162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.375355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.375537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.375709 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.375899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.375995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376088 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.376175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.376362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.376551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.376730 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376829 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.376975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.376975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.377149 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:27:17.377337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377436 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.377906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.378303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.378397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.378397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.378397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.378397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.379908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380175 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.380707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.381022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.381118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.381347 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.381639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.381739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.382096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.382423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.382566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.382750 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.382992 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.383135 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.383426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.383582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.383727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.383954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.384103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.384385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.384549 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.384953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.385172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.385326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.385609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.385768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.385929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.386166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.386324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.386528 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.386675 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.386850 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.387131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.387282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.387465 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.387644 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.387800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.388078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.388219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.388390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.388612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.388768 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.389431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.389629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.389773 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.389916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390058 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.390910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.391187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.391338 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.391490 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.391643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.391903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392210 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392847 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.392998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.393172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.393367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.393520 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.393832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.393972 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.394164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.394358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.394501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.394804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.394946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.395128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.395311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.395466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.395759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.395918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.396093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.396367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.396525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.396699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.396853 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.397084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.397243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.397425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.397782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.397945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.398200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.398344 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.398526 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.398792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.398947 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.399602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.399774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.399929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.400072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.400234 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.400376 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.400534 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.400534 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402872 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.402945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407429 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.407931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.408643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.408790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.408790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.409059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.409252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.409418 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.409828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.409929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410018 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410332 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410597 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410684 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410877 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.410973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411145 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411587 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.411679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.413582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.413582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.413782 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.413881 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.413881 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.414982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415068 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.415878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.416196 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.416284 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.416377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.419697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.419838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.419838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420042 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420042 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420446 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420552 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.420908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421648 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.421736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.422097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.423868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.423999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424189 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424485 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424580 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424674 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.424962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.425056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.425056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.425056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.425302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.425999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426108 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.426662 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427418 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427541 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427752 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.427945 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.429669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.429837 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.429949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430818 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.430991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.431254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.431572 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.431730 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.431894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.432226 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.432349 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.432579 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.432885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.433184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.433294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.433578 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.433786 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.433936 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.434380 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.434574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.434859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.434977 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.435212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.435432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.435553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.435829 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.435995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.436147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.436470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.436590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.436785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.437050 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.437183 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.437415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.437624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.437779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.438101 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.438252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.438419 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.438674 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.439033 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.439190 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.439980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.439980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440240 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440555 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440763 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.440920 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.441079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.441391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.441487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.441752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.441853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442504 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.442804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443318 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443478 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.443971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.444127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.444356 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.444576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.444675 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.444919 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445018 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.445897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446279 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446633 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.446940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.447275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.447423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.447601 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.447741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.447951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.448093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.448253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.448491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.448609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.448853 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449268 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449477 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.449862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450103 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450432 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.450840 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451155 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.451841 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.452055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.452172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.452381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.452524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.452675 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.453026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.453119 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.453339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.453444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.453732 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454780 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454874 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.454967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.455064 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.455266 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.455368 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.455601 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.455917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.456973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.457199 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.457513 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.457636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.457884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.457977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458529 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.458948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459284 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.459940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.460166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.460410 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.460510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.460743 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.460886 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461389 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.461823 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.462088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.462410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.462719 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.465608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.465759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.465847 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.465931 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466007 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466087 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466168 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466404 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466476 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466547 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466873 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.466946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467101 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467319 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467740 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.467964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468113 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468197 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468197 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.468677 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.469971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.470126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.470306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.470417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.470626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.470735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471155 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.471784 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472320 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.472943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473064 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473255 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473403 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473758 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.473957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474484 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.474962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.475126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.475285 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.475438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.476118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.476445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.476445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.476755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.476907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.477396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.477592 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.477767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.477930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.477930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.478240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.478405 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.478558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.478718 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.478877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479037 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479189 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479499 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.479962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480115 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480749 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.480902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.481912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482400 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482703 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.482854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483612 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.483933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484587 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.484898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485547 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.485859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486023 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486175 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486344 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486504 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.486979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.487131 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.487601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.487764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.487924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488086 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488398 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.488874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489499 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489772 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.489924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.490925 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.491106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.491780 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.491970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.492128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.492784 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493685 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.493849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.494859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495637 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495800 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.495959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496290 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496756 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.496910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.497061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.497212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.497383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.497681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.497852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498014 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498496 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.498966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.499916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500068 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.500996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.501147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.501304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.501469 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.501651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.501911 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502561 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.502873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503025 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503177 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.503973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.504143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.504305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.504469 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.504622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.505957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.506127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.506299 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.506443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.506589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.506755 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507699 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.507986 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508334 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508421 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.508904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509320 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.509933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510155 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510415 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510607 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.510973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511058 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511521 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.511877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.512885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.512996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513783 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513862 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.513983 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514140 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514434 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.514914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515089 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.515841 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516058 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.516794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517427 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517677 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.517789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.518975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519282 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519899 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.519994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.520206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.520443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.520546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.520771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.520872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521454 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.521915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.522207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.522373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.522613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.522745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523040 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.523940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.524933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.525926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.526151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.526246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.526518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.526698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.526837 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527064 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527525 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.527852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528403 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.528963 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.529967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530413 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530726 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.530934 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.531962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532671 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.532912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.533857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.534999 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535407 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535636 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.535951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536257 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.536976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.537189 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.537294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.537498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.537623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.537878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.538930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539055 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539233 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539503 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.539831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.540981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.541152 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.541341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.541482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.541690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.541841 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542796 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.542914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543146 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543400 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.543868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544321 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.544929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545157 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545823 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.545917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546464 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.546883 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547084 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.547800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548756 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.548973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.549958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550039 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550284 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550605 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550708 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.550922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551871 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.551963 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.552921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.553157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.553273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.553447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.553605 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.554350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.554890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.554890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555512 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.555850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556488 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.556830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557133 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557446 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.557799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558043 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558491 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.558819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559365 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559679 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559782 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.559994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.560945 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561043 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561259 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.561909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562003 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562534 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.562999 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.563866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564180 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564706 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.564809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565019 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565113 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565671 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565786 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.565986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.566924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567234 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.567917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568240 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.568893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.569083 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.569247 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.569846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.569980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570156 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570530 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.570843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571150 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571359 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571441 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.571996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.572996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573110 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573297 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573860 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.573988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574304 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574639 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.574969 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575796 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.575952 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.576940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577034 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.577948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578668 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.578988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.579932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580232 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580540 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580752 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.580856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.581830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582526 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582853 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.582943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.583185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.583291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.583501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.583627 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.583789 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:27:17.583895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.584119 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.584476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.584808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.585178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.585713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.585814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.586161 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.586489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.586804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.587121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.587497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.587816 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.588360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.588707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.589031 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.589373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.589734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.590046 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.590355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.590665 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.590993 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.591308 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.591618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.591930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.592244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.592555 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.592869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.593299 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.593485 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.593836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.594129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.594440 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.594750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.595062 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.595372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.595687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.596029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.596352 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.596671 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.596988 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.597309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.597645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.597958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.598267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.598582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.598897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.599226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.599544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.599852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.600272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.601577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.601911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.602241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.602558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.602885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.603210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.603528 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.603852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.604167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.604501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.604846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.605179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.605507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.605840 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.606149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.606505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.606821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.607146 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.607459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.608040 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.608355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.608669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.608978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.609288 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.609625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.609938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.610253 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.610559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.610862 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.611170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.611477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.611785 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.612093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.612404 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.612710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.613018 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.613324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.613654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.613958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.614295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.614629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.614946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.615270 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.615584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.615908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.616875 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.617295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.617608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.617930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.618242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.618577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.618891 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.619208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.619528 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.619842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.620156 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.620469 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.620798 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.621126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.621435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.621865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.622190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.622511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.622830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.623145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.623480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.623792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.624105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.624422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.624735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.625051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.625371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.625714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.626030 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.626351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.626670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.627004 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.627334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.627646 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.627974 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.628302 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.628655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.628972 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.629322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.629690 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.630011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.630325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.630634 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:27:17.630880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:27:17.693761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO dbcounter [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Registered counter for database nova_api Jul 28 22:27:17.715525 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_db.sqlalchemy.engines [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.722251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writer thread running {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.736278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO dbcounter [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Registered counter for database nova_api Jul 28 22:27:17.756647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_db.sqlalchemy.engines [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.763819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writer thread running {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.779928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.context [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39a213b2-8d6f-4b22-9f78-f4ccc3b99c66(cell1) {{(pid=118085) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 22:27:17.784030 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:27:17.785666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:27:17.786460 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:27:17.788497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:27:17.790471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO dbcounter [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Registered counter for database nova_cell0 Jul 28 22:27:17.794428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO dbcounter [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Registered counter for database nova_cell1 Jul 28 22:27:17.801373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_db.sqlalchemy.engines [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.803574 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_db.sqlalchemy.engines [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.808968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writer thread running {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.824656 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.context [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39a213b2-8d6f-4b22-9f78-f4ccc3b99c66(cell1) {{(pid=118086) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 22:27:17.828631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:27:17.830269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:27:17.831134 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:27:17.833118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:27:17.835194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO dbcounter [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Registered counter for database nova_cell0 Jul 28 22:27:17.839842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO dbcounter [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Registered counter for database nova_cell1 Jul 28 22:27:17.848538 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_db.sqlalchemy.engines [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.849949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_db.sqlalchemy.engines [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.856600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writer thread running {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.858891 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writer thread running {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.954249 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writer thread running {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:17.964256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO dbcounter [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Registered counter for database nova_cell0 Jul 28 22:27:17.971402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_db.sqlalchemy.engines [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:17.975989 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writer thread running {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:18.010222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO dbcounter [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Registered counter for database nova_cell0 Jul 28 22:27:18.017422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_db.sqlalchemy.engines [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:27:18.022107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writer thread running {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:27:18.297642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: WARNING keystonemiddleware.auth_token [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:27:18.305339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: WARNING keystonemiddleware.auth_token [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:27:18.349596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: WARNING keystonemiddleware.auth_token [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:27:18.357695 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: WARNING keystonemiddleware.auth_token [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:27:18.655841 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: WARNING keystonemiddleware.auth_token [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:27:18.661996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: WARNING keystonemiddleware.auth_token [None req-0ade682b-78ce-44b4-9600-befa61a78928 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:27:18.668093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdc4bc39c0 pid: 118085 (default app) Jul 28 22:27:18.708224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: WARNING keystonemiddleware.auth_token [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 22:27:18.714664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: WARNING keystonemiddleware.auth_token [None req-f3aeae3b-b743-4c7e-99b8-3b113f0ba4c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 22:27:18.720008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdc4bc39c0 pid: 118086 (default app) Jul 28 22:28:00.528043 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:00.529971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:00.530813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:00.533067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:01.667461 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-96f7407d-74a3-427c-b524-99ac4b182a94 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Action: 'create', calling method: .version_select at 0x7f743e204ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-235590793"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:02.892885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-96f7407d-74a3-427c-b524-99ac4b182a94 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.387128 Jul 28 22:28:02.900295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Jul 28 22:28:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 22:28:02.912983 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:02.917947 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:02.921184 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:02.922597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:03.196503 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1a212ad5-8976-4e6c-9bbb-d051b9e14a85 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dfdfdc0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:03.314190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1a212ad5-8976-4e6c-9bbb-d051b9e14a85 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0002b394-b759-480e-950f-b004819daa1b" status: 200 len: 351 microversion: 2.1 time: 0.122633 Jul 28 22:28:03.314851 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:03 2022] GET /compute/v2.1/os-volumes/0002b394-b759-480e-950f-b004819daa1b => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:03.326205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4415361c-2807-4e14-a4a5-2ccbf95effd1 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e188a60>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:04.079556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4415361c-2807-4e14-a4a5-2ccbf95effd1 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 200 len: 345 microversion: 2.1 time: 1.174202 Jul 28 22:28:04.081420 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:02 2022] GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 345 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:04.095514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a86d3429-4ee0-46a3-84e9-99355b7f48ac tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Action: 'create', calling method: .version_select at 0x7f743dff14c0>, body: {"snapshot": {"volume_id": "dc6efdea-da42-4b46-b04b-95601516a2a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-706944692"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:04.692964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a86d3429-4ee0-46a3-84e9-99355b7f48ac tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.600612 Jul 28 22:28:04.692964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 3/4] 10.222.0.39 () {60 vars in 1162 bytes} [Thu Jul 28 22:28:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:04.706012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9a08a173-5a07-467f-9587-a36214fcf3ff tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e050ca0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:04.876949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9a08a173-5a07-467f-9587-a36214fcf3ff tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.127352 Jul 28 22:28:04.876949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:04 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:04.878230 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f8f611e6-7cde-4cac-9266-30dc3a47c340 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743dff5550>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:04.936786 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f8f611e6-7cde-4cac-9266-30dc3a47c340 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.098802 Jul 28 22:28:04.937563 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1140 bytes} [Thu Jul 28 22:28:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:04.950177 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2c804e82-6252-4f9a-9007-a0b4c62abde9 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e00e430>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:05.010405 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2c804e82-6252-4f9a-9007-a0b4c62abde9 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.064805 Jul 28 22:28:05.011200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:04 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:05.053827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-21558ec7-04c9-4de1-8f23-a7b61270385f tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dff1310>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:05.118629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-21558ec7-04c9-4de1-8f23-a7b61270385f tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/29024e8a-acc0-42ce-8787-c976f66c3534" status: 200 len: 350 microversion: 2.1 time: 0.069845 Jul 28 22:28:05.119269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:05 2022] GET /compute/v2.1/os-volumes/29024e8a-acc0-42ce-8787-c976f66c3534 => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:06.023946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-53df52bf-5d23-458b-b436-62d717fe2b7c tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e050d30>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:06.100742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-53df52bf-5d23-458b-b436-62d717fe2b7c tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.081764 Jul 28 22:28:06.101250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 4/9] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:06 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:07.112995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b0214c6e-7661-41d2-8b97-87ec6b6e1f05 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743dfdfb80>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:07.174850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b0214c6e-7661-41d2-8b97-87ec6b6e1f05 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.065714 Jul 28 22:28:07.180588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 6/10] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:07 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:08.189361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c2a87b86-3bca-4aef-b337-42f6231b778b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e00e550>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:08.575112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c2a87b86-3bca-4aef-b337-42f6231b778b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.390343 Jul 28 22:28:08.575949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 5/11] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:08 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:09.081442 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7f12e5e9-bb07-4347-8413-84f4af91d3e1 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dff5af0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:09.192964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7f12e5e9-bb07-4347-8413-84f4af91d3e1 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5c751507-8a4a-48b3-ada0-5d49577c794e" status: 200 len: 350 microversion: 2.1 time: 0.118334 Jul 28 22:28:09.194596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:09 2022] GET /compute/v2.1/os-volumes/5c751507-8a4a-48b3-ada0-5d49577c794e => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:09.209971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-499e848c-6509-4954-8f4c-343937c1df2c tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743e00eaf0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:09.497928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-499e848c-6509-4954-8f4c-343937c1df2c tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.293610 Jul 28 22:28:09.499685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1134 bytes} [Thu Jul 28 22:28:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:09.527609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7321bf89-247a-4aa2-b5c2-c9387bf45a88 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dff1310>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:09.590037 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-30c14509-3a00-47ca-8711-7dcf5d2f4a38 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e050dc0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:09.685955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-30c14509-3a00-47ca-8711-7dcf5d2f4a38 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 287 microversion: 2.1 time: 0.101063 Jul 28 22:28:09.687333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 7/14] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:09 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:09.699131 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-281c5b02-d592-42f1-b039-7b23adcc444d tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e00e550>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:09.967124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-281c5b02-d592-42f1-b039-7b23adcc444d tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 202 len: 0 microversion: 2.1 time: 0.271928 Jul 28 22:28:09.968618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1254 bytes} [Thu Jul 28 22:28:09 2022] DELETE /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:28:09.978139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-baffda19-b541-48bb-925b-13ff046cf338 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e00e4c0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:10.018027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7321bf89-247a-4aa2-b5c2-c9387bf45a88 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.501461 Jul 28 22:28:10.029020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1149 bytes} [Thu Jul 28 22:28:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:10.034263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cbe78d88-c322-4cf0-8183-d9e9c4ecc355 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743e204e50>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:10.154508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-baffda19-b541-48bb-925b-13ff046cf338 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 200 len: 286 microversion: 2.1 time: 0.181883 Jul 28 22:28:10.157259 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 9/17] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:09 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:10.296999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cbe78d88-c322-4cf0-8183-d9e9c4ecc355 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.266552 Jul 28 22:28:10.298028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 9/18] 10.222.0.39 () {58 vars in 1134 bytes} [Thu Jul 28 22:28:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:10.323041 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0d39a7f5-f2a4-47ef-af9a-3d98055639e1 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743e050dc0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:10.511047 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0d39a7f5-f2a4-47ef-af9a-3d98055639e1 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.200103 Jul 28 22:28:10.511932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 10/19] 10.222.0.39 () {58 vars in 1167 bytes} [Thu Jul 28 22:28:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:10.525445 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b01492d8-1915-4e73-9378-b5c99376d0ae tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743e006160>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:10.737426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b01492d8-1915-4e73-9378-b5c99376d0ae tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.215742 Jul 28 22:28:10.739039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 10/20] 10.222.0.39 () {58 vars in 1170 bytes} [Thu Jul 28 22:28:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:10.756135 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8121b850-75fe-456a-83bc-83f4c4590647 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dfaf1f0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:10.991026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8121b850-75fe-456a-83bc-83f4c4590647 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.237916 Jul 28 22:28:10.991581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1155 bytes} [Thu Jul 28 22:28:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:11.004796 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0cd46987-6aa6-4d1e-9ef6-b83116733d50 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743e204e50>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:11.170062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e934e856-c25e-409a-9b10-022dac637448 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743dfafa60>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:11.220240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0cd46987-6aa6-4d1e-9ef6-b83116733d50 tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.219216 Jul 28 22:28:11.221090 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 11/22] 10.222.0.39 () {58 vars in 1188 bytes} [Thu Jul 28 22:28:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:11.236190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-60b7b2f3-8528-4c57-a1b4-bf808be5e09b tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] Calling method '.version_select at 0x7f743dff18b0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:11.293478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-e934e856-c25e-409a-9b10-022dac637448 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] HTTP exception thrown: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e934e856-c25e-409a-9b10-022dac637448 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Request method failure captured: Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 HTTP/1.1 Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w1wPsuMHoJVEzkryyd7UlmC0lo-drR38tSSRmo4XR8Iq_RUSdn1S73cf6cqALu7kOhUUYfJq_xpwVhmTf1IWeQjhwoTmU6HMWO3aHxi76FawWkZA675jXypKXeBam9M5tFChWKh6f1bIvK1rn4O-ZzLn0xfshAEoTnBgpkcY86xN3A Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:28:11.303460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 3eba3206e61043d3a81f49f71528bd7d Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '60d137e7-c05b-459c-9858-75455a53eb78'} Jul 28 22:28:11.304598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. (HTTP 404) (Request-ID: req-737fc2b8-29ee-4beb-87df-00cdeb9242d5) Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.305327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:11.306214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 22:28:11.307109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. Jul 28 22:28:11.308118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:28:11.310450 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e934e856-c25e-409a-9b10-022dac637448 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Returning 404 to user: Snapshot 60d137e7-c05b-459c-9858-75455a53eb78 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:28:11.311505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e934e856-c25e-409a-9b10-022dac637448 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78" status: 404 len: 111 microversion: 2.1 time: 0.145296 Jul 28 22:28:11.312243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:28:11 2022] GET /compute/v2.1/os-snapshots/60d137e7-c05b-459c-9858-75455a53eb78 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:28:11.324693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e66f2f68-7c0c-4307-8405-c34bf8fc33e4 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743dfafe50>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:11.477303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-60b7b2f3-8528-4c57-a1b4-bf808be5e09b tempest-VolumesTestJSON-337567805 tempest-VolumesTestJSON-337567805-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.245315 Jul 28 22:28:11.478748 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1155 bytes} [Thu Jul 28 22:28:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:11.636974 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e66f2f68-7c0c-4307-8405-c34bf8fc33e4 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 202 len: 0 microversion: 2.1 time: 0.318793 Jul 28 22:28:11.637849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:28:11 2022] DELETE /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:28:11.655501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-29796ba5-1d48-4204-9d6f-7302628d077e tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e008040>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:11.831030 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-29796ba5-1d48-4204-9d6f-7302628d077e tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 200 len: 344 microversion: 2.1 time: 0.186985 Jul 28 22:28:11.831622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:11 2022] GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:12.802084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5b943cf5-02df-4e91-95c7-787aac702cf7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: .version_select at 0x7f743dfafca0>, body: {"keypair": {"name": "tempest-keypair-837565009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGzin6pgNaMBcOmMPRTTtRPitpNYNwQpO9oRmlRmILO+/feO3DCQt/V8JirzgLGj2mmzVrYr+myhctSzJ+BPd7sJ1kJsN9JL9YyV40kJqR6GyO62krSUU3gEwA3JAOAtQ=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:12.847679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-747d00b7-640f-4e5d-9f61-c13650fe4b7f tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e0061f0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:12.910178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-747d00b7-640f-4e5d-9f61-c13650fe4b7f tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] HTTP exception thrown: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-747d00b7-640f-4e5d-9f61-c13650fe4b7f tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Request method failure captured: Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 HTTP/1.1 Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1wPsuMHoJVEzkryyd7UlmC0lo-drR38tSSRmo4XR8Iq_RUSdn1S73cf6cqALu7kOhUUYfJq_xpwVhmTf1IWeQjhwoTmU6HMWO3aHxi76FawWkZA675jXypKXeBam9M5tFChWKh6f1bIvK1rn4O-ZzLn0xfshAEoTnBgpkcY86xN3A Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:28:12.923522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 3eba3206e61043d3a81f49f71528bd7d Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'dc6efdea-da42-4b46-b04b-95601516a2a7'} Jul 28 22:28:12.924583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. (HTTP 404) (Request-ID: req-a78264ea-306e-47f2-ac44-c07a163ed62a) Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:12.925267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:12.927378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 22:28:12.928252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-747d00b7-640f-4e5d-9f61-c13650fe4b7f tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Returning 404 to user: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:28:12.929129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-747d00b7-640f-4e5d-9f61-c13650fe4b7f tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 404 len: 109 microversion: 2.1 time: 0.085387 Jul 28 22:28:12.947250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:12 2022] GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:28:12.966965 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-5b943cf5-02df-4e91-95c7-787aac702cf7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:12.978413 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9dd5a27e-b58b-4079-b691-37b9d2dbdc7b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743e006c10>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:13.018195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-5b943cf5-02df-4e91-95c7-787aac702cf7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for user b7e13e8c76cb4757a42568112d16bd27 and project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:13.077077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-9dd5a27e-b58b-4079-b691-37b9d2dbdc7b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] HTTP exception thrown: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9dd5a27e-b58b-4079-b691-37b9d2dbdc7b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Request method failure captured: Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 HTTP/1.1 Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1wPsuMHoJVEzkryyd7UlmC0lo-drR38tSSRmo4XR8Iq_RUSdn1S73cf6cqALu7kOhUUYfJq_xpwVhmTf1IWeQjhwoTmU6HMWO3aHxi76FawWkZA675jXypKXeBam9M5tFChWKh6f1bIvK1rn4O-ZzLn0xfshAEoTnBgpkcY86xN3A Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:28:13.080809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 3eba3206e61043d3a81f49f71528bd7d Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'dc6efdea-da42-4b46-b04b-95601516a2a7'} Jul 28 22:28:13.081898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. (HTTP 404) (Request-ID: req-faf60fdc-abb0-4978-8bb9-2e79029f5585) Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.083217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:28:13.084454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 22:28:13.085378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9dd5a27e-b58b-4079-b691-37b9d2dbdc7b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Returning 404 to user: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9dd5a27e-b58b-4079-b691-37b9d2dbdc7b tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 404 len: 109 microversion: 2.1 time: 0.127356 Jul 28 22:28:13.086291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:28:12 2022] DELETE /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:28:13.094936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3f8b7fae-1784-441e-ba89-85147ad214a0 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Calling method '.version_select at 0x7f743dff5ca0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:13.186599 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-3f8b7fae-1784-441e-ba89-85147ad214a0 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] HTTP exception thrown: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3f8b7fae-1784-441e-ba89-85147ad214a0 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Request method failure captured: Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 HTTP/1.1 Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1wPsuMHoJVEzkryyd7UlmC0lo-drR38tSSRmo4XR8Iq_RUSdn1S73cf6cqALu7kOhUUYfJq_xpwVhmTf1IWeQjhwoTmU6HMWO3aHxi76FawWkZA675jXypKXeBam9M5tFChWKh6f1bIvK1rn4O-ZzLn0xfshAEoTnBgpkcY86xN3A Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:28:13.189408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ed2b4c6eb126468794c0aefdecb418ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: ed2b4c6eb126468794c0aefdecb418ca Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834175751 Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 3eba3206e61043d3a81f49f71528bd7d Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834175751-project Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'dc6efdea-da42-4b46-b04b-95601516a2a7'} Jul 28 22:28:13.190584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. (HTTP 404) (Request-ID: req-7d866f7d-e83a-4563-b19e-25db23fa5246) Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.191251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:28:13.192757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 22:28:13.194252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3f8b7fae-1784-441e-ba89-85147ad214a0 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] Returning 404 to user: Volume dc6efdea-da42-4b46-b04b-95601516a2a7 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3f8b7fae-1784-441e-ba89-85147ad214a0 tempest-VolumesSnapshotsTestJSON-1834175751 tempest-VolumesSnapshotsTestJSON-1834175751-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7" status: 404 len: 109 microversion: 2.1 time: 0.102703 Jul 28 22:28:13.196248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 16/29] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:28:13 2022] GET /compute/v2.1/os-volumes/dc6efdea-da42-4b46-b04b-95601516a2a7 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:28:13.226810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5b943cf5-02df-4e91-95c7-787aac702cf7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.733314 Jul 28 22:28:13.240220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 14/30] 10.222.0.39 () {62 vars in 1200 bytes} [Thu Jul 28 22:28:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 750 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 22:28:15.528107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5f34288b-9f23-4899-9536-559df9d83e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: .version_select at 0x7f743dfdfc10>, body: {"keypair": {"name": "tempest-keypair-1203629947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF874R8thrbIjwRauG+M2gV/rDWp5sxt/luK4DjlNDxVVUFec8rtdAHq9/tbOP8JVGO1CWW8JLDFEEnQEdX0sma1ktMqcJQMkJR/QL72Aw6IyDCz6zY5GLqPnpuvNfJatA=="}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:15.703391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-5f34288b-9f23-4899-9536-559df9d83e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for project d829cbd8678145668ea811e01093fcfc. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:15.730754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-5f34288b-9f23-4899-9536-559df9d83e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for user 7476eccb0a6f4195936bec75f7f80c7d and project d829cbd8678145668ea811e01093fcfc. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:15.896836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5f34288b-9f23-4899-9536-559df9d83e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.691297 Jul 28 22:28:15.896836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 17/31] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:28:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:19.438105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-836191879", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "425ace09-193c-40d9-ace1-b357fa18c983"}], "security_groups": [{"name": "tempest-securitygroup--125895995"}], "key_name": "tempest-keypair-837565009", "user_data": "}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:19.982697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] validate_networks() for [('425ace09-193c-40d9-ace1-b357fa18c983', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:20.456964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cbe8c93b-bada-43e6-ab39-ad97648d59e6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: .version_select at 0x7f743df3b820>, body: {"keypair": {"name": "tempest-keypair-331479206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJihMdcam5MpfQmA93i5PWdLqq6gL/FZrDPRASzT5YLxPPxuZbyDBadwC5SRXjcIQeJ9He22AEBXntAYprBlxZX6W5/m0tQBOoLmEGYJk7W05MdHtGvydmYV4ZyXY+Wveg=="}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:20.549459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-cbe8c93b-bada-43e6-ab39-ad97648d59e6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:20.566232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-cbe8c93b-bada-43e6-ab39-ad97648d59e6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:20.640511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cbe8c93b-bada-43e6-ab39-ad97648d59e6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.888586 Jul 28 22:28:20.643169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 18/32] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:21.570440 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-984503957", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:21.805500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] validate_networks() for [('f48c6e9d-45a6-4c64-a517-0531b03b9307', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:23.062462 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=4 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:23.226603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:23.227041 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:23.227581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:23.228055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:23.228484 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:23.257039 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:23.257624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:23.258455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:23.259154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:23.318622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:23.323948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for user b7e13e8c76cb4757a42568112d16bd27 and project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:23.341833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:23.344775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:23.515196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4b3a03c3-12b3-47df-b3fc-6a8ebe3f1e7c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.081998 Jul 28 22:28:23.516411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 15/33] 10.222.0.39 () {62 vars in 1188 bytes} [Thu Jul 28 22:28:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 4084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 22:28:23.522599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2099342713", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "464fee12-f052-4124-8f6c-243235b340a4"}], "security_groups": [{"name": "tempest-securitygroup--116048605"}], "key_name": "tempest-keypair-1203629947", "user_data": "}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:24.510388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] validate_networks() for [('464fee12-f052-4124-8f6c-243235b340a4', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:24.990053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:24.990053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:24.990053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:24.996828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:24.997355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:25.025685 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:25.030506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:25.031414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:25.036371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:25.119858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:25.132913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for user afbab63bf079403b8ef652422d581d25 and project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:25.188494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:25.199039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:25.441199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1ec10560-170b-4e2e-8221-89ac80a95609 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.296246 Jul 28 22:28:25.442487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 19/34] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:28:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 4298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:28:25.456250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:25.456943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:26.102527 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:26.130142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:26.137891 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:26.148258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b1124d01-d135-46ef-94e7-15a2624911c8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1280 microversion: 2.20 time: 0.703683 Jul 28 22:28:26.149987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 20/35] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:25 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1280 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:26.169243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ab2294d2-d15d-4578-ab2e-50291dcea36d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:26.169995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ab2294d2-d15d-4578-ab2e-50291dcea36d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:26.445229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ab2294d2-d15d-4578-ab2e-50291dcea36d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:26.458693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ab2294d2-d15d-4578-ab2e-50291dcea36d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1221 microversion: 2.1 time: 0.301621 Jul 28 22:28:26.470343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 21/36] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:26 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1221 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:26.470343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-857966878", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ba94cd9-b91a-4088-b65d-e5c882850ab5"}], "security_groups": [{"name": "tempest-securitygroup--575387635"}], "key_name": "tempest-keypair-331479206", "user_data": "}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:27.022417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] validate_networks() for [('6ba94cd9-b91a-4088-b65d-e5c882850ab5', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:27.125945 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:27.126450 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:27.126714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:27.127292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:27.127902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:27.145264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:27.150197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:27.151382 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:27.153393 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:27.203859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for project d829cbd8678145668ea811e01093fcfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:27.214149 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for user 7476eccb0a6f4195936bec75f7f80c7d and project d829cbd8678145668ea811e01093fcfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:27.260065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:27.273216 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:27.455204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4ff6865e-9b8c-475a-83c3-7e991f6a0917 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.934202 Jul 28 22:28:27.461761 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 16/37] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:28:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:28:27.477363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-322542724", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:27.659393 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] validate_networks() for [('f48c6e9d-45a6-4c64-a517-0531b03b9307', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:29.174200 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:29.175240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:29.176477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:29.177044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:29.177637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:29.188434 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:29.189866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:29.196129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:29.196858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:29.232545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:29.237814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:29.255168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:29.257998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:29.328704 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c6972cfe-a3f4-4f69-9ed4-01a74aba4bf0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.866723 Jul 28 22:28:29.330061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 22/38] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:28:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:28:29.346438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:29.348982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:29.385778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:29.388231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:29.389144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:29.395880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:30.261330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:30.307585 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:30.314745 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:30.335054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-58596a07-2e16-41d7-b44d-8382d9fbf4a5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1338 microversion: 2.20 time: 0.999769 Jul 28 22:28:30.337900 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 23/39] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:29 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1338 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:30.373026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:30.392816 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:30.467577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:30.468228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:30.472951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:30.491625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:31.078375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:31.103951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4155dd44-aba8-43a1-92b8-7c53c76d7372 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1308 microversion: 2.1 time: 0.757631 Jul 28 22:28:31.112222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 24/40] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:30 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:31.388264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:31.389404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:31.390164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:31.392410 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:31.393985 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:31.430593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:31.432430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:31.436430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:31.440719 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:31.510682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:31.538550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for user afbab63bf079403b8ef652422d581d25 and project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:31.575906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:31.589959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:31.750070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-096d9890-851f-4482-a181-9115d81d359d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.279380 Jul 28 22:28:31.751070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 17/41] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:28:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:28:31.777437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:31.782427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:31.825617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:31.829153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:31.830344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:31.832758 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:31.988760 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1350399906", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "networks": [{"uuid": "3b321d51-83e0-4fab-8ede-145e708993ba"}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:32.094712 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:32.119917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] validate_networks() for [('3b321d51-83e0-4fab-8ede-145e708993ba', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:28:32.130358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e3574e2f-edb3-44b2-ac0d-ab7fb4882977 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1244 microversion: 2.1 time: 0.372182 Jul 28 22:28:32.131394 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 18/42] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:31 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1244 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:32.149695 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:32.150333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:32.170014 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:32.170512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:32.178106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:32.178106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:32.906073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:32.919399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:32.928412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:32.930812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2d35ef15-a36e-41e5-8267-177375d25c6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.798202 Jul 28 22:28:32.932522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 19/43] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:32 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:32.947048 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:32.948326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:32.968576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:32.970321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:32.974161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:32.974803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.192189 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:28:33.192771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:28:33.193126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:28:33.193576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:28:33.193998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:28:33.212393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.212855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.213743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.214192 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.261081 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:33.276116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bf0b4c0a-d7dd-4f8c-a320-1ccc9456118e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1225 microversion: 2.1 time: 0.340274 Jul 28 22:28:33.277906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 20/44] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:32 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1225 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:33.287724 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Getting quotas for project cb92681d2af8498cb7456a70354ccf39. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:28:33.292164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Getting quotas for user 4ed2359ca8cb4ee18984c14a5c3646b1 and project cb92681d2af8498cb7456a70354ccf39. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:28:33.321663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:28:33.324459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:28:33.349070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:33.370257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:33.389003 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.389776 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.390821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.391406 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.455417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8701544e-1b06-4249-8a94-d2cc9c585f2c tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341713 Jul 28 22:28:33.466669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 25/45] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:28:33.479503 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:33.482275 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:33.483555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:33.504343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.504874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.505702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-894d0dec-6ba9-4a68-b3bc-64397afdd325 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1296 microversion: 2.1 time: 0.226096 Jul 28 22:28:33.505809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.506190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.507745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 21/46] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:33 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:33.515232 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0e400664-0b09-4032-8437-33c8de6b45b4 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:33.517138 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0e400664-0b09-4032-8437-33c8de6b45b4 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:33.520822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=10 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:33.643672 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0e400664-0b09-4032-8437-33c8de6b45b4 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:33.686589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0e400664-0b09-4032-8437-33c8de6b45b4 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1215 microversion: 2.1 time: 0.171791 Jul 28 22:28:33.691237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 22/47] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:33 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:33.747364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:33.760398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-06c78d63-80fa-45bf-8201-5663be65e55f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1244 microversion: 2.1 time: 0.290562 Jul 28 22:28:33.762326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:33 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1244 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:33.961216 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:33.964340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:33.980363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.981724 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:33.985413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:33.986180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:34.306667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:34.307293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:34.325141 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:34.325936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:34.328520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:34.330279 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:34.690467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:34.704727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c4c622e6-8961-4038-8873-c7fd2dcd9d19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1217 microversion: 2.1 time: 0.403706 Jul 28 22:28:34.718671 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 27/49] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:34 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1217 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:34.746016 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:34.746562 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:34.792754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:34.793846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:34.794817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:34.795402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:34.918785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:34.936075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:34.940354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:34.941687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-51868bd2-e54d-42ee-84fd-7a1c12876914 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.986056 Jul 28 22:28:34.957851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 23/50] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:33 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:34.984738 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:34.994785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:35.023495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:35.026432 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:35.027585 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:35.030580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:35.210720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:35.226357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2371be26-3da7-4abb-b4fb-980890c1c510 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1296 microversion: 2.1 time: 0.505639 Jul 28 22:28:35.247678 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 28/51] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:34 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1296 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:35.264522 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:35.266252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:35.287653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:35.288368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:35.289144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:35.289609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.151912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.172088 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-11580eb6-d445-48ba-8c49-4cdcc60ac2e6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1219 microversion: 2.1 time: 1.211256 Jul 28 22:28:36.172723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 24/52] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:34 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1219 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:36.193671 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:36.202158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:36.228784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.229472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.234711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.236717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.308414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.319706 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8ce5bd5c-b86d-436a-a462-ce573c267ed0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1300 microversion: 2.1 time: 1.068414 Jul 28 22:28:36.341576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 29/53] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:35 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1300 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:36.372560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:36.383079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:36.421963 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.422670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.426679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.427545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.490362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.499245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-10dcf8b9-4dfe-44af-aa65-1683c4f528b8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1291 microversion: 2.1 time: 0.322438 Jul 28 22:28:36.510260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 25/54] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:36 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1291 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:36.528428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:36.530466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:36.540183 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.549726 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.551453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:36.552254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:36.755070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.779971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-77eb6362-a63a-4d57-b35b-393a55a22573 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1296 microversion: 2.1 time: 0.258062 Jul 28 22:28:36.786553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 26/55] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:36 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:36.936880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.949044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.958572 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:36.962320 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-afc5f6e3-471f-4433-927d-9df01daaab1d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.616400 Jul 28 22:28:36.964641 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 30/56] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:36 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:37.199324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:37.200077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:37.213472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.214463 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.218977 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.222518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.344154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:37.344782 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:37.357747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.358221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.359002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.359462 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.856065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:37.887196 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:37.898028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a95fe325-4115-4a59-813a-0e7bd8098b80 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1267 microversion: 2.1 time: 0.681030 Jul 28 22:28:37.913917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 27/57] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:37 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1267 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:37.917684 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f5ec90c0-2bfc-4b27-9a2e-2c7553726da2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1298 microversion: 2.1 time: 0.576314 Jul 28 22:28:37.926538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 31/58] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:37 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1298 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:37.934506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:37.937721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:37.955373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:37.961883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:37.977519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.978011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.978796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:37.979258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:37.986045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:38.012520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:38.016433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:38.021996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:38.023101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:38.569650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:38.591134 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a6a860e6-b6d8-41a9-b749-864882d17fdc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1279 microversion: 2.1 time: 0.685187 Jul 28 22:28:38.591754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 28/59] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:37 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1279 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:38.608151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:38.621753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:38.652185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:38.652821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:38.664891 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:38.665763 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:39.428855 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:39.442706 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:39.448586 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:39.451236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f0ab6c50-ebe6-4c51-8690-146555ab8b03 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.856042 Jul 28 22:28:39.454512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 29/60] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:38 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:39.462916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:39.465697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:39.481353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:39.484398 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:39.486241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:39.487123 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:39.815363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:39.833456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ad64c2f4-492c-4379-9fd3-87a5ba3a8c9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 1.901805 Jul 28 22:28:39.849809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 32/61] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:37 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:39.875720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:39.880206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:39.897806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:39.899130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:39.902960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:39.903693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:39.919256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:39.937221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-316d2164-420d-4263-8518-c7d203cf536a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1273 microversion: 2.1 time: 0.480373 Jul 28 22:28:39.939970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 30/62] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:39 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1273 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:40.065115 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:40.075325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f90f8803-ceb9-462c-b60c-0e7ddf23aa0b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1298 microversion: 2.1 time: 0.223517 Jul 28 22:28:40.093657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:39 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:40.110209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:40.112954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:40.114316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-50be3718-1edc-4eca-a707-645a6a786682 req-2ef19c13-948e-42cc-bae8-0b2b36308bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:40.126865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.129979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.131150 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.131889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.194647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-50be3718-1edc-4eca-a707-645a6a786682 req-2ef19c13-948e-42cc-bae8-0b2b36308bea service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.195056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-50be3718-1edc-4eca-a707-645a6a786682 req-2ef19c13-948e-42cc-bae8-0b2b36308bea service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.309854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-50be3718-1edc-4eca-a707-645a6a786682 req-2ef19c13-948e-42cc-bae8-0b2b36308bea service nova] Creating event network-changed:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:28:40.313055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-50be3718-1edc-4eca-a707-645a6a786682 req-2ef19c13-948e-42cc-bae8-0b2b36308bea service nova] Acquired lock "compute-rpcapi-router" {{(pid=118086) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 22:28:40.314864 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.319374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.329508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.330334 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.363658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.compute.rpcapi [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 22:28:40.365186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] Releasing lock "compute-rpcapi-router" {{(pid=118086) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 22:28:40.391399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9a2f11c5-dbc0-4b46-af0f-00ebcb19bedf None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.446011 Jul 28 22:28:40.392376 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 31/64] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:40.477702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:40.478322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:40.492279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.492739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.493540 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.500126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.659091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:40.668718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6662ad26-595e-4f41-ae25-6e91f3fd0ac4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1279 microversion: 2.1 time: 0.573596 Jul 28 22:28:40.675448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:40 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1279 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:40.868845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:40.870482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:40.883164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.884181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:40.885368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:40.887498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:41.287458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:41.304816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:41.308115 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:41.314488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0a67bce3-5cc9-4899-bd9f-63efa439eb3c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.839706 Jul 28 22:28:41.316656 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 32/66] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:40 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:41.332284 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:41.337238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:41.360160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:41.360652 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:41.361458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:41.361946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:41.834244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:41.848470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1372bcac-28b6-4603-a726-237e9d99601c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.983604 Jul 28 22:28:41.851826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:40 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:41.870943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:41.872356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:41.908770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:41.914124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:41.916211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:41.920501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.112974 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:42.131806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ae7d04ee-4e4a-423a-b6c0-3f987efd2f94 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.811539 Jul 28 22:28:42.165372 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 33/68] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:41 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:42.182544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:42.186584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:42.205021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.214351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.215467 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.217368 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.225797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:42.245296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-927e6b66-ca20-4dc6-b86f-dde1f9608002 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1298 microversion: 2.1 time: 0.388149 Jul 28 22:28:42.249212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 36/69] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:41 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1298 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:42.418769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-a8e0ad24-d974-42fa-9d08-57959c924884 req-aa5af475-ad4f-456b-9f37-d5765e189f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cb74f8-85be-4e53-82a7-ca38fd38cbf5", "tag": "5fadf80f-a549-46e0-b26a-9fad8d146f17"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:42.441042 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-a8e0ad24-d974-42fa-9d08-57959c924884 req-aa5af475-ad4f-456b-9f37-d5765e189f75 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.442024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-a8e0ad24-d974-42fa-9d08-57959c924884 req-aa5af475-ad4f-456b-9f37-d5765e189f75 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.477277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-a8e0ad24-d974-42fa-9d08-57959c924884 req-aa5af475-ad4f-456b-9f37-d5765e189f75 service nova] Creating event network-changed:5fadf80f-a549-46e0-b26a-9fad8d146f17 for instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 on hv-cinder-85093 Jul 28 22:28:42.477853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-a8e0ad24-d974-42fa-9d08-57959c924884 req-aa5af475-ad4f-456b-9f37-d5765e189f75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 22:28:42.479034 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.479481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.480307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.480905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.493250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.compute.rpcapi [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 22:28:42.494194 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] Releasing lock "compute-rpcapi-router" {{(pid=118085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 22:28:42.519515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4d4428e6-b52f-4cae-8227-8ce2855fb536 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265643 Jul 28 22:28:42.520113 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 37/70] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:42.525638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:42.526677 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:42.533936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.535271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.536850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.537588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.631582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:42.636144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:42.653388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-53f20150-b6a2-4ff5-87b6-c9f1d8d7815e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1279 microversion: 2.1 time: 0.486636 Jul 28 22:28:42.654019 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 34/71] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:42 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1279 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:42.873318 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:42.874262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:42.893427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.894108 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:42.900414 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:42.901106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:43.211638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:43.221974 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:43.227902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:43.232724 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1cdfdc92-3e8b-4711-9d5c-7dba3b9ff71e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.711464 Jul 28 22:28:43.233943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 38/72] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:42 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:43.239577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:43.240181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:43.263443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:43.265947 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:43.267300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:43.267743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:43.323171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=30 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:43.665254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=20 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:44.458663 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:44.479849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b189ef1a-9543-442c-b735-7237fddc2b71 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 1.611304 Jul 28 22:28:44.483036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 35/73] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:42 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:44.483292 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:44.487381 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:44.496127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d03381fa-c7d7-4fa0-9d6c-6190bb687211 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 1.260904 Jul 28 22:28:44.502510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 39/74] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:43 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:44.507946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:44.508821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:44.515632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:44.516693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:44.521289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:44.526258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:44.527310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:44.529852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:44.539856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:44.540899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:44.541747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:44.542214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.024316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.048790 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-adf43670-4860-4a50-88fc-fe69a060b26b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.543393 Jul 28 22:28:45.051637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 40/75] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:44 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:45.058649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:45.062645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:45.075214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.078556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.081985 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.082777 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.100037 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.119120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f25cce96-7f2d-48a9-81ef-a9e0abe91573 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.634251 Jul 28 22:28:45.129286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 36/76] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:44 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:45.291263 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-42c3d6f0-53b1-4c71-8eb7-6e5cfb3085b6 req-d2f01afc-afb1-4c31-bbf6-fe9c9570c004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e409c8d-d62d-41f4-a0ca-652816028ff6", "tag": "ef9daab1-0a25-49ef-87c4-25f58c4308ae"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:45.328058 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-42c3d6f0-53b1-4c71-8eb7-6e5cfb3085b6 req-d2f01afc-afb1-4c31-bbf6-fe9c9570c004 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.328512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-42c3d6f0-53b1-4c71-8eb7-6e5cfb3085b6 req-d2f01afc-afb1-4c31-bbf6-fe9c9570c004 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.370505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-42c3d6f0-53b1-4c71-8eb7-6e5cfb3085b6 req-d2f01afc-afb1-4c31-bbf6-fe9c9570c004 service nova] Creating event network-changed:ef9daab1-0a25-49ef-87c4-25f58c4308ae for instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 on hv-cinder-85093 Jul 28 22:28:45.393251 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-42c3d6f0-53b1-4c71-8eb7-6e5cfb3085b6 req-d2f01afc-afb1-4c31-bbf6-fe9c9570c004 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105482 Jul 28 22:28:45.395932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 37/77] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:45.459369 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.471278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.473306 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.493808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-499f43f2-772d-4c77-9a83-983ae274dff6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.421660 Jul 28 22:28:45.494493 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 41/78] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:45 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:45.511702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:45.512476 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:45.527639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:45.528456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:45.530594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.531081 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.531894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.535377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.553296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.555228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.556232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.556953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.795878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.805137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8b75b9e9-23cf-414b-bb51-0aad731f0eca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.299077 Jul 28 22:28:45.818339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 38/79] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:45 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:45.840948 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:45.851448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a8e7b55d-9891-4fc5-899d-a87fafdbc816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.328758 Jul 28 22:28:45.852059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 42/80] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:45 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:45.927557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-86cdc02b-ee0a-40b5-9b5d-bc76454b3fd0 req-28cda5df-c8d4-4254-b32c-c56a3b6b55f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc2682a-cbca-49c8-8e74-2d9ed7062e93", "tag": "35af7134-fcd8-416d-b6f7-11f5d93a4613"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:45.947173 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-86cdc02b-ee0a-40b5-9b5d-bc76454b3fd0 req-28cda5df-c8d4-4254-b32c-c56a3b6b55f7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:45.947766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-86cdc02b-ee0a-40b5-9b5d-bc76454b3fd0 req-28cda5df-c8d4-4254-b32c-c56a3b6b55f7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:45.965704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-86cdc02b-ee0a-40b5-9b5d-bc76454b3fd0 req-28cda5df-c8d4-4254-b32c-c56a3b6b55f7 service nova] Creating event network-changed:35af7134-fcd8-416d-b6f7-11f5d93a4613 for instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 on hv-cinder-85093 Jul 28 22:28:45.972699 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-86cdc02b-ee0a-40b5-9b5d-bc76454b3fd0 req-28cda5df-c8d4-4254-b32c-c56a3b6b55f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053594 Jul 28 22:28:45.973874 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 39/81] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:46.071915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:46.073185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:46.083226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.084002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.084967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.085602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.157118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:46.161778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:46.179837 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.180296 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.181155 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.181789 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.369949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:46.380263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2b13826b-38b7-4ee2-b740-f1ee037857e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.312869 Jul 28 22:28:46.396979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 43/82] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:46 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:46.521211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:46.523145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:46.537118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.538188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.539324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.543226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.581189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:46.602291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ff09a2a7-052a-4e0d-8e1f-919c2fa56f76 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.452027 Jul 28 22:28:46.602885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 40/83] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:46 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:46.811327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:46.831806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:46.833270 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:46.842364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:46.848915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.850281 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.850420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:46.852245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.853915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.860591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6139e6ed-23b5-4da4-b320-a68b96e8bc17 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.343976 Jul 28 22:28:46.865952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 44/84] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:46 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:46.875543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:46.876436 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:46.887128 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.887919 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:46.889191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:46.890468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.196402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:47.210151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d53f2654-568f-43e1-b292-5a82a05391f2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.380995 Jul 28 22:28:47.227273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 41/85] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:46 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:47.284314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:47.293851 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2959aa7a-c1c6-44be-acfe-706ebc5f1f85 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.423404 Jul 28 22:28:47.294690 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 45/86] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:46 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:47.401458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:47.401984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:47.410895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.411245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.412012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.417137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.629422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:47.630630 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:47.640120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.640806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.641488 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.641955 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.656179 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:47.665237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6de3bd26-a01c-4335-ac28-81790ad19f88 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.268016 Jul 28 22:28:47.665856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 42/87] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:47 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:47.888399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:47.889005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:47.899451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.899915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.900694 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:47.901128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:47.921170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:47.935318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bb89a1c1-39fc-4be5-949b-5063801795ce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.315026 Jul 28 22:28:47.936374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 46/88] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:47 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:48.004637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e2af9e-d8ce-4edd-8aae-4158d00ef92f", "tag": "3a6a91e7-1223-4e3c-8af2-8617d06c63d2"}, {"name": "network-changed", "server_uuid": "20092e58-9863-4f05-95a2-6bb6a42ca0f5", "tag": "9978da88-5a78-4aab-a326-2ea421a9deb1"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:48.022301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.023166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.041431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] Creating event network-changed:3a6a91e7-1223-4e3c-8af2-8617d06c63d2 for instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f on hv-cinder-85093 Jul 28 22:28:48.042410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] Creating event network-changed:9978da88-5a78-4aab-a326-2ea421a9deb1 for instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 on hv-cinder-85093 Jul 28 22:28:48.052910 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-34c0b4d6-4b35-4552-bea7-6575fe694e1d req-115bb275-0596-4589-a1b4-3c062788d513 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051892 Jul 28 22:28:48.055082 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 47/89] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:48.220831 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.232021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.234700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:48.235695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:48.238166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.242321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-eae8227c-9d74-4214-92b7-35634d2ef8d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.357093 Jul 28 22:28:48.243820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 43/90] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:47 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:28:48.247671 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.248304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.249442 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.250138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.326730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:48.327356 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:48.336271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.336730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.337516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.338036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.642543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.653142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.662537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4e828218-db57-4997-be28-3bc3b600be1e tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.349583 Jul 28 22:28:48.663151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 44/91] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:48 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:48.667616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d80cf650-1d6e-4370-bab7-42228ee03a84 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.439263 Jul 28 22:28:48.668385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 48/92] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:48 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:48.686669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:48.687820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:48.699460 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.700116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.702229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.706022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.954393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:48.959196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:48.959904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:48.965695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8dbfe4a0-5597-426b-8ae3-e0e85333b5c5 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.283335 Jul 28 22:28:48.966974 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 49/93] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:48 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:48.967990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.968451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:48.969232 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:48.969705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.136704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:49.146024 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-72240fee-2cb3-45f3-a109-6df70f8c5b8a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.191461 Jul 28 22:28:49.160089 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 45/94] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:48 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:49.271061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:49.271764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:49.278470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.279168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.280162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.280833 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.447170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:49.466862 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:49.469357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:49.470657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4c33e243-9c20-4bb8-aa94-6c930d345245 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.204042 Jul 28 22:28:49.472261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 50/95] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:49 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:49.684582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:49.687268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:49.692037 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:49.692718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:49.699204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.699922 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.701850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.702949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.703098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.703522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.704652 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:49.710071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:49.970193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:49.981242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9300393c-729d-4caa-b22b-3dbe18c117d0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.294990 Jul 28 22:28:49.982651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 51/96] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:49 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:50.003173 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.015225 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9af59acf-7071-4276-af40-50c239bf800b tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.334444 Jul 28 22:28:50.017343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:50.021002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:50.029889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 46/97] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:49 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:50.041022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.042938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.045431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.046302 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.167982 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:50.168598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:50.175204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.175661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.178850 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.179300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.300374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.312712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a9d1ea0c-9fdc-4403-a264-09a0b6588e21 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.312687 Jul 28 22:28:50.314457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 52/98] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:49 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:50.350500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=8 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:50.358518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.372840 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-96395048-2d91-4231-8507-78fcc55469fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.208931 Jul 28 22:28:50.373808 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 47/99] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:50 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:50.494241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:50.494954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:50.507612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.507993 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.509046 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:50.513125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:50.719035 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.730172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.732690 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:50.734444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-351876eb-4925-406b-9f7e-8bae3be44a69 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.244337 Jul 28 22:28:50.735649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 53/100] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:50 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:51.004498 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:51.005108 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:51.011659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.012051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.012840 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.013437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.037895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:51.038789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:51.045673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.046711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.047820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.048574 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.276843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.286295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ac03d330-4370-44e7-9023-04c29ff23f36 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.286517 Jul 28 22:28:51.300380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:50 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:51.308689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.323511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bcd727fa-6d92-42a4-972a-2347650232dc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.289834 Jul 28 22:28:51.335631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:51.336364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:51.340152 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:51 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:51.356422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.357079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.358118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.358668 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.397654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:51.398566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:51.407155 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.409615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.410537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.411049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.578464 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.587857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8e42f41a-4ba0-4669-b3dd-4e327ee37dc6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.256735 Jul 28 22:28:51.588831 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:51 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:51.602853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.611666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b3a0807e-0187-454e-a1f7-549ba35ebb6b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.218756 Jul 28 22:28:51.612309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 55/104] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:51 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:51.757305 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:51.758237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:51.778276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.779465 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.780481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.781111 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.960542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.966123 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-8624fa92-381e-446f-ae4c-ce2c57745806 req-da4ed055-b118-4827-899b-1ad313e373d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "name": "network-vif-plugged", "status": "completed", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:51.969698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.971737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:51.973084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e334d13d-e9fc-4ec2-9b70-b2cffbea78e2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.220567 Jul 28 22:28:51.973709 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 50/105] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:51 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:51.981333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-8624fa92-381e-446f-ae4c-ce2c57745806 req-da4ed055-b118-4827-899b-1ad313e373d9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:51.981826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-8624fa92-381e-446f-ae4c-ce2c57745806 req-da4ed055-b118-4827-899b-1ad313e373d9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:51.994290 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-8624fa92-381e-446f-ae4c-ce2c57745806 req-da4ed055-b118-4827-899b-1ad313e373d9 service nova] Creating event network-vif-plugged:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:28:51.999112 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-8624fa92-381e-446f-ae4c-ce2c57745806 req-da4ed055-b118-4827-899b-1ad313e373d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096048 Jul 28 22:28:51.999709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 56/106] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:52.317868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:52.317868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:52.317868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.317868 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.318573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.318573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.362394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:52.373897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:52.380045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.380045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.380377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.380812 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.492409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=8 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:52.633318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:52.637404 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:52.647414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-17f51701-6476-4f59-8832-839639c90f7a tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.287628 Jul 28 22:28:52.648737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:52.660049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-908695e8-5fab-4fc0-add5-05f4dc1557ee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.354116 Jul 28 22:28:52.660793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 51/107] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:52 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:52.662356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:52 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:52.666443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:52.667197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:52.674550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.675323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.676545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.677143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.678747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:52.679385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:52.689459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.689935 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.693064 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:52.698932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:52.911721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:52.919214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:52.921432 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-542d2345-6daa-40f9-919e-d41f86e022a0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.259336 Jul 28 22:28:52.935539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 52/109] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:52 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:53.001238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:53.002793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:53.014717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.015182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.015962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.016396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.040581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.051172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1db63922-7fcb-4670-8bef-eb49c8efb288 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.385989 Jul 28 22:28:53.053724 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 58/110] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:52 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:53.188824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.197090 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.199073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.200372 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-52233af1-0e42-4d99-8c51-a135db0b707f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.205882 Jul 28 22:28:53.200935 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 53/111] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:52 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:53.669023 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:53.669682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:53.684382 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:53.684988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:53.696325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.697749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.698410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.704510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.704510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.704682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.704682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.704682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.961160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.970864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-be9ce158-ea6e-4fd9-9755-50fe02548947 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.305844 Jul 28 22:28:53.972392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:53.973604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 59/112] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:53 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:53.979735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:53.980354 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:53.987381 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.988490 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:53.989515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:53.990432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.001438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d9e91f8a-9bdf-4a68-8299-5fb60ebd6b43 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.323184 Jul 28 22:28:54.002436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 54/113] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:53 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:54.028796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-e0f8e5aa-c35e-4fc1-b8af-e12ef04ac1b9 req-d50fce1e-994f-4766-a41a-e644eb391589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cb74f8-85be-4e53-82a7-ca38fd38cbf5", "name": "network-vif-plugged", "status": "completed", "tag": "5fadf80f-a549-46e0-b26a-9fad8d146f17"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:54.042267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e0f8e5aa-c35e-4fc1-b8af-e12ef04ac1b9 req-d50fce1e-994f-4766-a41a-e644eb391589 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:54.042725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e0f8e5aa-c35e-4fc1-b8af-e12ef04ac1b9 req-d50fce1e-994f-4766-a41a-e644eb391589 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.056834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-e0f8e5aa-c35e-4fc1-b8af-e12ef04ac1b9 req-d50fce1e-994f-4766-a41a-e644eb391589 service nova] Creating event network-vif-plugged:5fadf80f-a549-46e0-b26a-9fad8d146f17 for instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 on hv-cinder-85093 Jul 28 22:28:54.062790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-e0f8e5aa-c35e-4fc1-b8af-e12ef04ac1b9 req-d50fce1e-994f-4766-a41a-e644eb391589 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038729 Jul 28 22:28:54.063968 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 55/114] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:28:54.081775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:54.081775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:54.104908 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:54.109933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.110808 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:54.111257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.233040 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:54.242491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-251bd6c1-1d21-4a5e-816b-53c43a01d1ae tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.267223 Jul 28 22:28:54.243058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 60/115] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:53 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:54.259281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:54.260128 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:54.277928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:54.278558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.279472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:54.280261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:54.379081 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:54.387623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c2c97986-860b-457d-93c0-8a404e6c2c11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.316360 Jul 28 22:28:54.388360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 56/116] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:54 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:28:54.458232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:54.467981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:54.469836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:54.471088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-13b46afc-8200-4b30-8f79-9747c1cafc97 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.221460 Jul 28 22:28:54.472303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 61/117] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:54 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:54.993973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:54.994592 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:55.000847 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.001302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.002105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.003250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.030742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:55.030742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:55.039505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.040209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.041772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.042367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.396271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:55.406735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-21dcfbfa-0afe-4d70-b61c-4e592759511a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.382210 Jul 28 22:28:55.411986 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:55 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:55.417134 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:55.419949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:55.427115 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:55.428602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.429245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.430205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.430794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.439146 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e573c40a-4a83-4af7-9c1a-024a45459d91 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.448820 Jul 28 22:28:55.445645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 57/119] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:54 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:55.449767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:55.450385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:55.457124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.457618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.458398 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.458835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.656505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:55.666421 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4916ee06-283b-4feb-8c89-6af2f6747f5c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.253033 Jul 28 22:28:55.669442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:55.679936 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fe8bb8c8-6195-4df2-a787-c96a92f44a1e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.237633 Jul 28 22:28:55.680509 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 58/120] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:55 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:55.681554 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 63/121] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:55 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:55.688188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:55.688800 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:55.697253 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.697786 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:55.706264 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:55.713855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.115981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.124647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.126203 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.127400 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2ecd013c-60be-48a5-841d-4294042079cd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1405 microversion: 2.20 time: 0.444382 Jul 28 22:28:56.128665 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 64/122] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:55 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:56.427360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:56.428505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:56.435154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.435641 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.436424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.436865 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.460172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:56.460777 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:56.467244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.467937 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.468847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.469733 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.678430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.689362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a91129d5-2e32-4de0-bcc2-62ebd92171fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.266366 Jul 28 22:28:56.690978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 59/123] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:56 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:56.696343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:56.697331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:56.706524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.714143 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-734d2354-3237-418f-8bbf-6d719808b7b9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.257836 Jul 28 22:28:56.725628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 65/124] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:56 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:56.725898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.725898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.725898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.725898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.732235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:56.732832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:56.750717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.751172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.757384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:56.758157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:56.980314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:56.994356 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-68d0fcc2-c285-4e50-989a-e91dcdede5f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.301893 Jul 28 22:28:56.996552 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 60/125] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:56 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:57.005466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-98fb1f41-5044-42be-9de5-a21086ff5ab6 req-19d80f7b-a0c3-47f4-9c83-0caebf3d982c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e2af9e-d8ce-4edd-8aae-4158d00ef92f", "name": "network-vif-plugged", "status": "completed", "tag": "3a6a91e7-1223-4e3c-8af2-8617d06c63d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:57.025955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-98fb1f41-5044-42be-9de5-a21086ff5ab6 req-19d80f7b-a0c3-47f4-9c83-0caebf3d982c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.027000 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:57.028187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-98fb1f41-5044-42be-9de5-a21086ff5ab6 req-19d80f7b-a0c3-47f4-9c83-0caebf3d982c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.039559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6ddf4cc1-2cce-4054-8b65-678ff293e839 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.323763 Jul 28 22:28:57.040378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 66/126] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:56 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:57.055874 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-98fb1f41-5044-42be-9de5-a21086ff5ab6 req-19d80f7b-a0c3-47f4-9c83-0caebf3d982c service nova] Creating event network-vif-plugged:3a6a91e7-1223-4e3c-8af2-8617d06c63d2 for instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f on hv-cinder-85093 Jul 28 22:28:57.062644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-98fb1f41-5044-42be-9de5-a21086ff5ab6 req-19d80f7b-a0c3-47f4-9c83-0caebf3d982c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063737 Jul 28 22:28:57.063540 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 61/127] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:57.166903 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:57.167524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:57.175829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.176624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.177690 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.178341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.438539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:57.448477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:57.450538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:57.451930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-051085e5-78a4-4c7c-904f-420c41c09f9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1598 microversion: 2.20 time: 0.289859 Jul 28 22:28:57.452956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 67/128] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:28:57 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1598 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:28:57.480385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:57.484524 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:57.495260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.495931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.496961 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.497604 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.682948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bb68840e-52ca-4838-9e76-07763a050278 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.209519 Jul 28 22:28:57.683655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 62/129] 10.222.0.39 () {60 vars in 1316 bytes} [Thu Jul 28 22:28:57 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:28:57.711918 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:57.712537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:57.719558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.720017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.720805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.721274 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.741730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:57.743262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:57.755044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.756285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:57.758695 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:57.759498 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:58.005127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:58.017895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:58.019141 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-110bda3b-f7d3-4284-84f0-efcd24e7eff9 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.282853 Jul 28 22:28:58.031098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c4f7acca-c970-4b35-918a-992162e3853c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.322871 Jul 28 22:28:58.032649 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 63/130] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:57 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:58.045602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 68/131] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:57 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:58.052298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:58.053787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:58.067591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:58.068464 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:58.069501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:58.070101 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:58.070994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:58.074520 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:58.091544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:58.092355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:58.093615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:58.094290 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:58.379249 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:58.391847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-614276e3-9e22-4014-9cb0-c22e302ee5f5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1365 microversion: 2.1 time: 0.333979 Jul 28 22:28:58.392444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 69/132] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:58 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:58.454714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:58.465495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2173011c-ae8c-4098-9000-713b368551d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.431590 Jul 28 22:28:58.467333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 64/133] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:58 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:59.041663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:59.042483 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:59.049635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.050453 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.051475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.052123 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.055050 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:59.055664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:59.065494 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.067061 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.068385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.069053 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.292705 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:59.303723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-20d4bbe8-30f7-4c71-9b79-39bc62ee69f1 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.266886 Jul 28 22:28:59.313925 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:59.314645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 70/134] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:59 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:59.316257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d9d7560b-a7ae-45e7-b9e7-d9e71404edcd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.264822 Jul 28 22:28:59.330171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20092e58-9863-4f05-95a2-6bb6a42ca0f5", "name": "network-vif-plugged", "status": "completed", "tag": "9978da88-5a78-4aab-a326-2ea421a9deb1"}, {"server_uuid": "1e409c8d-d62d-41f4-a0ca-652816028ff6", "name": "network-vif-plugged", "status": "completed", "tag": "ef9daab1-0a25-49ef-87c4-25f58c4308ae"}, {"server_uuid": "8cc2682a-cbca-49c8-8e74-2d9ed7062e93", "name": "network-vif-plugged", "status": "completed", "tag": "35af7134-fcd8-416d-b6f7-11f5d93a4613"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:59.331664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 65/135] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:59 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:59.338971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.340128 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.359939 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Creating event network-vif-plugged:9978da88-5a78-4aab-a326-2ea421a9deb1 for instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 on hv-cinder-85093 Jul 28 22:28:59.360887 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Creating event network-vif-plugged:ef9daab1-0a25-49ef-87c4-25f58c4308ae for instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 on hv-cinder-85093 Jul 28 22:28:59.361487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] Creating event network-vif-plugged:35af7134-fcd8-416d-b6f7-11f5d93a4613 for instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 on hv-cinder-85093 Jul 28 22:28:59.371005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-c64c6fef-fd80-4e3f-bd8c-eb1b15c8e1c6 req-f17c2d3e-b4e0-4aa6-9171-0d2453b537d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054234 Jul 28 22:28:59.374292 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 71/136] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:28:59.419779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:59.420608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:59.434924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.435381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.436160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.436595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.496904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:59.497916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:59.509914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.510855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.512238 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.513886 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.835494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:59.843944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3620ea1a-a4bc-4174-83c8-101a3517ed5d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.356570 Jul 28 22:28:59.859569 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 72/137] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:59 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:59.906655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:28:59.917304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-1e0d0084-a2c0-4604-bf72-74840941b25e req-0bb829a5-9fc3-455e-b57e-3f502a964e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:28:59.932205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-67a7d273-9755-4198-8d7b-786dafea2a35 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1556 microversion: 2.1 time: 0.516904 Jul 28 22:28:59.935144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 66/138] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:28:59 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1556 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:28:59.964941 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-1e0d0084-a2c0-4604-bf72-74840941b25e req-0bb829a5-9fc3-455e-b57e-3f502a964e3c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.965565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-1e0d0084-a2c0-4604-bf72-74840941b25e req-0bb829a5-9fc3-455e-b57e-3f502a964e3c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.974133 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:28:59.976424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:28:59.983803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.988483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:28:59.990757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:28:59.993208 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.000414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-1e0d0084-a2c0-4604-bf72-74840941b25e req-0bb829a5-9fc3-455e-b57e-3f502a964e3c service nova] Creating event network-changed:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:29:00.021475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-1e0d0084-a2c0-4604-bf72-74840941b25e req-0bb829a5-9fc3-455e-b57e-3f502a964e3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109183 Jul 28 22:29:00.024265 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 73/139] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:00.188435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f24c5dc4-c404-45bd-9f7f-6eac1157566a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229029 Jul 28 22:29:00.199115 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 67/140] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:28:59 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:29:00.329457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:00.330530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:00.340920 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:00.341697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:00.343500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.344860 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.347833 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.349447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.352590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.354709 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.357507 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.358180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.727026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:00.738464 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f13923c0-5498-4783-8bc4-b1a3c5b40756 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.402159 Jul 28 22:29:00.739871 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 68/141] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:00 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:00.771876 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:00.781936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b2a0416c-4acd-41b4-b11d-339133d87962 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1315 microversion: 2.1 time: 0.457417 Jul 28 22:29:00.797568 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 74/142] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:00 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:00.874722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:00.876867 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:00.906422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.906422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:00.906422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:00.906422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:01.067799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:01.076832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d89a4e94-6d7f-44ff-ab67-6eb60ffdb538 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.212466 Jul 28 22:29:01.077399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 69/143] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:00 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:01.761078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:01.761739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:01.773473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:01.774175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:01.775211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:01.775807 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:01.804747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:01.805291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:01.815757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:01.817255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:01.820109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:01.821085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:02.066241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:02.070184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:02.080393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-eb39d253-487b-4ab1-8a12-44773e8a2861 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1363 microversion: 2.1 time: 0.324286 Jul 28 22:29:02.105745 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 75/144] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:01 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:02.113244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:02.114187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:02.129596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:02.130543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:02.132565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:02.133182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:02.196898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:02.208973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a66631a3-7a85-4801-a750-eb6164c30b75 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1502 microversion: 2.1 time: 0.408422 Jul 28 22:29:02.210071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 70/145] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:01 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:02.457804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:02.468467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d4afbe5f-33b0-4c34-9e40-99beea337354 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1321 microversion: 2.1 time: 0.361227 Jul 28 22:29:02.482280 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-8060698d-d6bd-4b79-b892-e268cdbfa7cc req-b4afe1e5-f731-49e3-9215-1291b51fd22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e2af9e-d8ce-4edd-8aae-4158d00ef92f", "tag": "3a6a91e7-1223-4e3c-8af2-8617d06c63d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:02.483673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 76/146] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:02 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:02.511013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:02.522697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-8060698d-d6bd-4b79-b892-e268cdbfa7cc req-b4afe1e5-f731-49e3-9215-1291b51fd22f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:02.524672 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-8060698d-d6bd-4b79-b892-e268cdbfa7cc req-b4afe1e5-f731-49e3-9215-1291b51fd22f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:02.564082 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-8060698d-d6bd-4b79-b892-e268cdbfa7cc req-b4afe1e5-f731-49e3-9215-1291b51fd22f service nova] Creating event network-changed:3a6a91e7-1223-4e3c-8af2-8617d06c63d2 for instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f on hv-cinder-85093 Jul 28 22:29:02.576458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-8060698d-d6bd-4b79-b892-e268cdbfa7cc req-b4afe1e5-f731-49e3-9215-1291b51fd22f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100565 Jul 28 22:29:02.578462 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 71/147] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:03.118892 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:03.121054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:03.156721 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.160808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.162905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.169789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.371080 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:03.391606 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2d10d8f3-6a55-4add-ac27-fb6f8ee407ad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1549 microversion: 2.1 time: 0.278132 Jul 28 22:29:03.393447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 77/148] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:03 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1549 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:03.416174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:03.416859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:03.423536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.424841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.426260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.426701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.430873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:03.492891 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:03.493863 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:03.501629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.502372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.503601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.504307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.550668 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e7d9b86e-2241-41ec-9623-79ad7ebf37d7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139572 Jul 28 22:29:03.551720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 72/149] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:29:03 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:29:03.759951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:03.775190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-028c7a2c-3a2c-4e8e-b582-91e220011328 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1515 microversion: 2.1 time: 0.279888 Jul 28 22:29:03.775877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 78/150] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:03 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:03.797129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:03.799717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:03.812493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.813139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.814227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:03.814917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:03.852586 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lazy-loading 'flavor' on Instance uuid 20092e58-9863-4f05-95a2-6bb6a42ca0f5 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:29:04.007699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733af00f-3fd9-49af-8286-1770c873d97f"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:04.012937 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:04.041476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:04.042136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:04.045401 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:04.047319 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:04.120035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-52ea8337-30e9-4ad6-a4a7-309a70baac59 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5/action" status: 200 len: 32 microversion: 2.1 time: 0.326772 Jul 28 22:29:04.120888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 73/151] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:29:03 2022] POST /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:29:04.131870 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:04.134800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:04.148424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:04.152076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:04.154844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:04.156129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:04.491729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:04.504316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a90a28ad-5b93-4e73-a938-f3b97f56696a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.377112 Jul 28 22:29:04.522307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 74/152] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:04 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:05.040901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4b778f00-48a9-4d32-bb77-dcaecba71dc6 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "POST /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.038342 Jul 28 22:29:05.042494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 79/153] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:29:04 2022] POST /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:05.543821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:05.544575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:05.553548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:05.555602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:05.558095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:05.558809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:05.767112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:05.775833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f4e88ca3-fa9c-4c68-81ef-3cf634c83984 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.236410 Jul 28 22:29:05.776510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 75/154] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:05 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:06.799977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:06.800416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:06.815825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:06.816997 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:06.817850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:06.820211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:06.881063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-e4311c60-a5e2-4269-990a-9f147f67cc6b req-126177c6-7137-4b3a-a0b6-65485e115055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc2682a-cbca-49c8-8e74-2d9ed7062e93", "tag": "35af7134-fcd8-416d-b6f7-11f5d93a4613"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:06.893287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e4311c60-a5e2-4269-990a-9f147f67cc6b req-126177c6-7137-4b3a-a0b6-65485e115055 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:06.894039 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e4311c60-a5e2-4269-990a-9f147f67cc6b req-126177c6-7137-4b3a-a0b6-65485e115055 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:06.905999 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-e4311c60-a5e2-4269-990a-9f147f67cc6b req-126177c6-7137-4b3a-a0b6-65485e115055 service nova] Creating event network-changed:35af7134-fcd8-416d-b6f7-11f5d93a4613 for instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 on hv-cinder-85093 Jul 28 22:29:06.912064 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-e4311c60-a5e2-4269-990a-9f147f67cc6b req-126177c6-7137-4b3a-a0b6-65485e115055 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Jul 28 22:29:06.913004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 76/155] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:07.112217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:07.122074 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-836dc559-36d8-4f30-93c8-a5102a8b25d0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.329135 Jul 28 22:29:07.122667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 80/156] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:06 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:08.147302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:08.148011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:08.155074 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:08.155844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:08.157081 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:08.157518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:08.372981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:08.383869 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-db0f5d8a-4814-4b62-955a-9cc3d51578b9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.241639 Jul 28 22:29:08.384901 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 77/157] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:08 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:09.406785 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:09.410914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:09.413431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=97 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:09.419872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:09.420507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:09.421432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:09.421943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:09.555904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:09.563616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bb32e4aa-ef8c-41c3-9e6d-ab4f4d6a3512 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.161210 Jul 28 22:29:09.565213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 81/158] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:09 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:10.587634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:10.588809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:10.596246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:10.598191 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:10.600066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:10.600551 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:10.774732 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:10.782361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-78000b75-4b10-4dff-af3b-5f537a0ca968 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.199587 Jul 28 22:29:10.783871 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 78/159] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:10 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:11.805184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:11.805895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:11.813209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:11.813788 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:11.815964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:11.816505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:11.989124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:11.996932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-dc067bdf-ff2a-4e6c-b841-2ac622a6a5db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.195774 Jul 28 22:29:11.997515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 82/160] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:11 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:13.017797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:13.018435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:13.024439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:13.024899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:13.025699 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:13.026144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:13.175705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:13.183816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2ddbe122-c5f9-4186-8b99-18f890990fb3 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.169876 Jul 28 22:29:13.184577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 79/161] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:13 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:13.203624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-365494079", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "networks": [{"uuid": "7afec142-10eb-4a87-a472-31d060e69e64"}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:13.261945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] validate_networks() for [('7afec142-10eb-4a87-a472-31d060e69e64', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:29:13.668195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:29:13.668614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:29:13.669199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:29:13.669636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:29:13.670072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:29:13.678952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:13.679393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:13.680788 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:13.681479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:13.699895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Getting quotas for project da5c439035bf4fe1bcf123752ab0566f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:29:13.703831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Getting quotas for user 9d5b147068c2491c9e4c95bbf5d0cbdd and project da5c439035bf4fe1bcf123752ab0566f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:29:13.716377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:29:13.718810 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:29:13.766632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9dabfdf0-fc4e-446c-8163-c72b3c678c3f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566796 Jul 28 22:29:13.767981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 83/162] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:29:13.778625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0aa4f9dd-fd67-46c3-90fe-0aa78400356a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:13.779349 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0aa4f9dd-fd67-46c3-90fe-0aa78400356a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:13.838828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0aa4f9dd-fd67-46c3-90fe-0aa78400356a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:13.846074 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0aa4f9dd-fd67-46c3-90fe-0aa78400356a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1218 microversion: 2.1 time: 0.071036 Jul 28 22:29:13.846912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 80/163] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:13 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:14.206379 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:14.208431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:14.215267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.215717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.216471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.216902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.357922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:14.366277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-92bcab41-0b2d-4993-bfa1-22f4dce7ad45 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.163907 Jul 28 22:29:14.366868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 84/164] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:14 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:14.867472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:14.868086 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:14.875010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.875461 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.876377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.877178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.921803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:14.922689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:14.930332 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.931144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.934075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:14.938268 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:14.991851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:14.997932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:29:15.010865 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-561f635b-b95d-4bd0-beb1-589f4378887c tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1270 microversion: 2.1 time: 0.147300 Jul 28 22:29:15.015075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 81/165] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:14 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:15.122967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-490a7dce-4be4-452f-9e2d-2f4b8ed177af tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 204 len: 0 microversion: 2.1 time: 0.204769 Jul 28 22:29:15.123649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 85/166] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:29:14 2022] DELETE /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:29:15.133766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:15.134603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:15.141356 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:15.142015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:15.142812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:15.143428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:15.272194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:15.280248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d937e43c-a365-489b-8d23-49b24526083f tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1554 microversion: 2.1 time: 0.151757 Jul 28 22:29:15.280856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 82/167] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:15 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:15.388210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:15.388911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:15.396623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:15.397085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:15.397889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:15.398329 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:15.529043 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:15.537410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d72fd81d-96bd-4a51-8fa0-cdc0bafe5d60 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.154070 Jul 28 22:29:15.538024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 86/168] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:15 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:16.040824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:16.043140 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:16.049288 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.049774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.050721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.051164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.123431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:16.131774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d8f1746a-2a20-4df4-bf83-0a93d0c0a72d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1276 microversion: 2.1 time: 0.095178 Jul 28 22:29:16.132332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 83/169] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:16 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:16.302542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:16.303261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:16.309768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.310241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.311107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.311829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.453989 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:16.462326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b70d4adc-ffb1-46ce-8a5f-6c0873f58602 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1554 microversion: 2.1 time: 0.164652 Jul 28 22:29:16.463277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 87/170] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:16 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:16.558331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:16.558943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:16.565797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.566194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.566955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:16.567392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:16.699182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:16.707590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4442ab3f-21ea-46b9-a0be-faba5540e20a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.153059 Jul 28 22:29:16.708167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 84/171] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:16 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:17.153500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:17.154304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:17.162276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.163137 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.163919 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.164351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.235766 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:17.243906 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3fcfd639-0fe4-4058-bce1-cac6e6da2ba6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1276 microversion: 2.1 time: 0.094365 Jul 28 22:29:17.244580 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 88/172] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:17 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:17.482768 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:17.483416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:17.489505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.489976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.490736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.491164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.618188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:17.626139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5b4be846-8e52-4a51-abe6-8afd055e57cf tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1554 microversion: 2.1 time: 0.147252 Jul 28 22:29:17.627300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 85/173] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:17 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:17.728775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:17.729323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:17.736412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.737050 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.737836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:17.738275 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:17.867047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:17.874543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-75a78c8d-5347-405c-bfcd-0910c36ce7fd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.149742 Jul 28 22:29:17.875114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 89/174] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:17 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:18.264323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:18.264939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:18.271595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.272048 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.272811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.273245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.336583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:18.344053 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4b3bed73-52cf-4df4-b17d-63114ea9c0d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1276 microversion: 2.1 time: 0.083506 Jul 28 22:29:18.344618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 86/175] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:18 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:18.647752 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:18.648390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:18.654481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.654926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.655689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.656119 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.660836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:18.897015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:18.897742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:18.903765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.904219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.904984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:18.905443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:18.987808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:18.995638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7f4300f7-cffe-49e4-8cd3-26091d5c11e7 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1554 microversion: 2.1 time: 0.351750 Jul 28 22:29:18.996249 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 90/176] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:18 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1554 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:19.046931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:19.054392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d66b5993-f053-470f-872d-b6919a61cc0b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.161279 Jul 28 22:29:19.054950 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 87/177] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:18 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:19.365746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:19.366365 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:19.372398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:19.372845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:19.373632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:19.374087 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:19.441169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:19.448591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f4c673be-2b2d-4488-b354-ed736f7072fe tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1276 microversion: 2.1 time: 0.086804 Jul 28 22:29:19.449160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 91/178] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:19 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:20.018296 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:20.018932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:20.024880 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.025329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.026156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.026597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.075594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:20.076193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:20.086925 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.087378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.088142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.088742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.214886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:20.219630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:20.228189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-17e4fd47-be8a-4f73-b4e8-b2f39dbeeacc tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1554 microversion: 2.1 time: 0.214353 Jul 28 22:29:20.228959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 88/179] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:20 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:20.256057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:20.265365 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b6317dfa-0895-457b-a07b-3c0910e4fe77 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.193204 Jul 28 22:29:20.265995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 92/180] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:20 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:20.468539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:20.469230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:20.477363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.478180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.479104 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:20.480171 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:20.630843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:20.640506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-09b5de2c-1d8d-47bf-8f04-6ca26511cb9e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.176068 Jul 28 22:29:20.642701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 89/181] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:20 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:21.252895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:21.253479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:21.260262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.260710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.261475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.262139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.291280 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:21.291992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:21.299164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.300066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.301171 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.301879 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.375473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:21.403877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9f854372-bb0a-4bdd-9e6c-00cc6512bf37 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1512 microversion: 2.1 time: 0.156784 Jul 28 22:29:21.407661 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 93/182] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:21 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:21.488353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-c4d25b73-ae28-45f1-bef4-7d10825de714 req-59aba6ca-9e5a-47a2-bfac-0fb7d159e636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e409c8d-d62d-41f4-a0ca-652816028ff6", "name": "network-vif-deleted", "tag": "ef9daab1-0a25-49ef-87c4-25f58c4308ae"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:21.500419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c4d25b73-ae28-45f1-bef4-7d10825de714 req-59aba6ca-9e5a-47a2-bfac-0fb7d159e636 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.502351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c4d25b73-ae28-45f1-bef4-7d10825de714 req-59aba6ca-9e5a-47a2-bfac-0fb7d159e636 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.518731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c4d25b73-ae28-45f1-bef4-7d10825de714 req-59aba6ca-9e5a-47a2-bfac-0fb7d159e636 service nova] Creating event network-vif-deleted:ef9daab1-0a25-49ef-87c4-25f58c4308ae for instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 on hv-cinder-85093 Jul 28 22:29:21.525133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-c4d25b73-ae28-45f1-bef4-7d10825de714 req-59aba6ca-9e5a-47a2-bfac-0fb7d159e636 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044305 Jul 28 22:29:21.526162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 94/183] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:21.539308 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:21.549892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9c3282e4-24e5-4aba-8a48-088e88383c19 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.266885 Jul 28 22:29:21.551211 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 90/184] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:21 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:21.665938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:21.666740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:21.674987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.675388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.676170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:21.676608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:21.825700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:21.834338 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-38042c31-34f7-43aa-b873-e8872c36c375 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.173096 Jul 28 22:29:21.846242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 95/185] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:21 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:22.427256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:22.427896 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:22.434102 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.434600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.435311 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.435746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.468125 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.468651 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.469438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lazy-loading 'fault' on Instance uuid 1e409c8d-d62d-41f4-a0ca-652816028ff6 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:29:22.512766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed2359ca8cb4ee18984c14a5c3646b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb92681d2af8498cb7456a70354ccf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:22.521246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a19fb079-04ac-4906-9785-dc3e44789816 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 200 len: 1351 microversion: 2.1 time: 0.098084 Jul 28 22:29:22.521850 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 91/186] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:22 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:22.571261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:22.571903 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:22.578465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.581764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.582570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.583018 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.717353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:22.725078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3743f3f7-104b-43b4-9c4a-c7c7d7c2c39f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.157584 Jul 28 22:29:22.725677 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 96/187] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:22 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:22.860228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:22.860860 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:22.866903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.867354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:22.868126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:22.868564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.000470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:23.008791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fab2edfb-0d84-4cd2-a563-f1d0cc717d93 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.155511 Jul 28 22:29:23.009355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 92/188] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:22 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:23.542513 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:23.543029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:23.549856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.550351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.551116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.551567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.565186 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] HTTP exception thrown: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Request method failure captured: Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 HTTP/1.1 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2LlKNH7DMZBTU3ShfbQkrh3fy4AG-He9Vjn7BLECfSkAXKxACTL1LA4Pd9c2d7-ZPuoPWnlVYe42SXvgOrt53yb_uHVjApsp-SQtc0dT91h6O7a5JsUl5417FaCZB7Dl2jVgXz55ToVnV5A-7lN2pFOexRUwumqwR_xZTw0C060HQ Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:29:23.569953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 4ed2359ca8cb4ee18984c14a5c3646b1 Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.571971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '1e409c8d-d62d-41f4-a0ca-652816028ff6'} Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:29:23.572843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.574276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.575496 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Returning 404 to user: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:29:23.575496 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ca2caf35-1bfc-4286-8d74-75c3b41e498d tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 404 len: 111 microversion: 2.1 time: 0.032815 Jul 28 22:29:23.575496 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 97/189] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:23 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:29:23.586676 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-a1f6db3a-8a1b-4d75-9646-68ebf8fafeba req-e7319e93-1fcc-4691-9333-c3c782ca4cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a48d55-8f82-4f28-ab27-957d404713fd", "tag": "8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:23.597049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-a1f6db3a-8a1b-4d75-9646-68ebf8fafeba req-e7319e93-1fcc-4691-9333-c3c782ca4cb8 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.597548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-a1f6db3a-8a1b-4d75-9646-68ebf8fafeba req-e7319e93-1fcc-4691-9333-c3c782ca4cb8 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.608690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-a1f6db3a-8a1b-4d75-9646-68ebf8fafeba req-e7319e93-1fcc-4691-9333-c3c782ca4cb8 service nova] Creating event network-changed:8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2 for instance 82a48d55-8f82-4f28-ab27-957d404713fd on hv-cinder-85093 Jul 28 22:29:23.614545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-a1f6db3a-8a1b-4d75-9646-68ebf8fafeba req-e7319e93-1fcc-4691-9333-c3c782ca4cb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Jul 28 22:29:23.615135 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 93/190] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:29:23.696564 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:23.698853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:23.701286 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:23.707618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.708071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.708843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.709293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.713167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=6 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:23.725347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] HTTP exception thrown: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Request method failure captured: Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6/os-volume_attachments HTTP/1.1 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2LlKNH7DMZBTU3ShfbQkrh3fy4AG-He9Vjn7BLECfSkAXKxACTL1LA4Pd9c2d7-ZPuoPWnlVYe42SXvgOrt53yb_uHVjApsp-SQtc0dT91h6O7a5JsUl5417FaCZB7Dl2jVgXz55ToVnV5A-7lN2pFOexRUwumqwR_xZTw0C060HQ Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:29:23.727179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 4ed2359ca8cb4ee18984c14a5c3646b1 Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.728604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'server_id': '1e409c8d-d62d-41f4-a0ca-652816028ff6'} Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:29:23.729385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:23.730466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:23.731561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Returning 404 to user: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:29:23.731561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-106c520d-d8cc-4890-a1ee-1f627fd55c40 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036229 Jul 28 22:29:23.731561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 98/191] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:29:23 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:29:23.746919 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:23.747610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:23.754002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.754489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.755278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:23.755713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:23.846119 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:23.907025 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:23.918844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f79e86b9-5033-4eb4-9d62-4adb9b30ee05 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.176201 Jul 28 22:29:23.919423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 94/192] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:23 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:24.029815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:24.030553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:24.037598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.038052 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.038894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.039366 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.187261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:24.195284 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9c169fd2-e056-4b5d-9b20-dbee40c1649a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.169351 Jul 28 22:29:24.195855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 99/193] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:24 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:24.940100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:24.940701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:24.947027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.947473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.948567 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.949006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.953915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:24.954485 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:24.960933 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.961425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.962297 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.962766 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.977111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] HTTP exception thrown: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Request method failure captured: Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 HTTP/1.1 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2LlKNH7DMZBTU3ShfbQkrh3fy4AG-He9Vjn7BLECfSkAXKxACTL1LA4Pd9c2d7-ZPuoPWnlVYe42SXvgOrt53yb_uHVjApsp-SQtc0dT91h6O7a5JsUl5417FaCZB7Dl2jVgXz55ToVnV5A-7lN2pFOexRUwumqwR_xZTw0C060HQ Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:29:24.978842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 4ed2359ca8cb4ee18984c14a5c3646b1 Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:24.980353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '1e409c8d-d62d-41f4-a0ca-652816028ff6'} Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:29:24.984283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:24.986408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:24.987729 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Returning 404 to user: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:29:24.987729 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7adc8b81-6aa2-438e-8faa-68698f699558 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 404 len: 111 microversion: 2.1 time: 0.030234 Jul 28 22:29:24.987729 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 100/194] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:29:24 2022] DELETE /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:29:24.989430 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:24.990086 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] [instance: 1e409c8d-d62d-41f4-a0ca-652816028ff6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:24.996309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.998683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:24.998683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:24.998683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:25.013209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] HTTP exception thrown: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Request method failure captured: Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 HTTP/1.1 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2LlKNH7DMZBTU3ShfbQkrh3fy4AG-He9Vjn7BLECfSkAXKxACTL1LA4Pd9c2d7-ZPuoPWnlVYe42SXvgOrt53yb_uHVjApsp-SQtc0dT91h6O7a5JsUl5417FaCZB7Dl2jVgXz55ToVnV5A-7lN2pFOexRUwumqwR_xZTw0C060HQ Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:29:25.014967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb92681d2af8498cb7456a70354ccf39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: cb92681d2af8498cb7456a70354ccf39 Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-DeleteServersTestJSON-1340518043 Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 4ed2359ca8cb4ee18984c14a5c3646b1 Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-DeleteServersTestJSON-1340518043-project Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:25.016327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '1e409c8d-d62d-41f4-a0ca-652816028ff6'} Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:29:25.017158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. Jul 28 22:29:25.018874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:29:25.020187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] Returning 404 to user: Instance 1e409c8d-d62d-41f4-a0ca-652816028ff6 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:29:25.020187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-333a0c6f-9fc5-4e88-a78e-c3a5cde252b8 tempest-DeleteServersTestJSON-1340518043 tempest-DeleteServersTestJSON-1340518043-project] 10.222.0.39 "GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6" status: 404 len: 111 microversion: 2.1 time: 0.032751 Jul 28 22:29:25.020187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 101/195] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:24 2022] GET /compute/v2.1/servers/1e409c8d-d62d-41f4-a0ca-652816028ff6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:29:25.195782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:25.203976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-09530388-ddaa-482a-8dbc-0420cddd0ff9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.267530 Jul 28 22:29:25.205441 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 95/196] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:24 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:25.229399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:25.230139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:25.239006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:25.240123 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:25.241132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:25.241792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:25.476863 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:25.484882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-291d4028-aa2e-4c3c-b8a5-0a160bbf7c67 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.265043 Jul 28 22:29:25.485307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 102/197] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:25 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:26.232516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:26.233945 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:26.241138 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:26.241862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:26.242841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:26.243538 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:26.506770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:26.507438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:26.514778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:26.515234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:26.516024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:26.516462 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:26.699428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:26.710806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6e012a45-faf4-4283-a9e2-468d533db1c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.482251 Jul 28 22:29:26.711388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 96/198] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:26 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:26.893154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:26.902824 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-72a0194f-8c1c-4436-ac57-7aa16ba260e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.400161 Jul 28 22:29:26.904566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 103/199] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:26 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:27.732308 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:27.732925 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:27.744764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:27.745214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:27.746019 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:27.746456 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:27.935438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:27.937751 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:27.945250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:27.946191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:27.946962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:27.947517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:28.092141 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:28.102980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-651cde35-4713-4146-9fd8-51cf6814aa7d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.374474 Jul 28 22:29:28.103572 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 97/200] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:27 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:28.170334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:28.180520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-acc37ced-c25a-4ba2-9b75-4ccaf50c48cc tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.253558 Jul 28 22:29:28.185267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 104/201] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:27 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:28.348310 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-ab898a8c-7688-4b20-bfec-1e21409741c6 req-aee1143a-dca7-4878-baa9-3693dfc933ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a48d55-8f82-4f28-ab27-957d404713fd", "name": "network-vif-plugged", "status": "completed", "tag": "8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:28.363086 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ab898a8c-7688-4b20-bfec-1e21409741c6 req-aee1143a-dca7-4878-baa9-3693dfc933ba service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:28.363775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ab898a8c-7688-4b20-bfec-1e21409741c6 req-aee1143a-dca7-4878-baa9-3693dfc933ba service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:28.380729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-ab898a8c-7688-4b20-bfec-1e21409741c6 req-aee1143a-dca7-4878-baa9-3693dfc933ba service nova] Creating event network-vif-plugged:8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2 for instance 82a48d55-8f82-4f28-ab27-957d404713fd on hv-cinder-85093 Jul 28 22:29:28.388640 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-ab898a8c-7688-4b20-bfec-1e21409741c6 req-aee1143a-dca7-4878-baa9-3693dfc933ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042933 Jul 28 22:29:28.390027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 98/202] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:29:29.126941 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:29.127749 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:29.134682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:29.135207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:29.136038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:29.136588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:29.206787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:29.207398 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:29.213835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:29.214496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:29.216381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:29.216987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:29.428963 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:29.440157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8295397b-7968-4286-b607-68ec6545e53f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.317947 Jul 28 22:29:29.440737 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 105/203] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:29 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:29.479348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:29.489283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-08861593-65e8-4aeb-91b6-6dd6cd8fed22 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1318 microversion: 2.1 time: 0.287328 Jul 28 22:29:29.505095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 99/204] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:29 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:30.464725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:30.465602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:30.472918 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:30.473393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:30.474221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:30.474670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:30.511317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:30.511930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:30.518851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:30.519217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:30.519980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:30.520408 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:30.886102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:30.894465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ccb5027e-01d2-419b-a416-cd7d177d72bc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.433555 Jul 28 22:29:30.895058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 106/205] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:30 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:30.917727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:30.926100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-382228cb-08d7-4366-953a-9b1668b79361 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1507 microversion: 2.1 time: 0.419217 Jul 28 22:29:30.926665 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 100/206] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:30 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:31.915531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:31.916046 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:31.922614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:31.923063 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:31.923821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:31.924256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:32.049850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:32.057387 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-11ae332a-f648-42e3-96b2-4c417bc13859 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.145780 Jul 28 22:29:32.057988 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 107/207] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:31 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:33.079544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:33.080096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:33.082029 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=64 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:33.087416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:33.087859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:33.088613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:33.089042 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:33.218294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:33.226609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-517558c8-e9d4-4ba6-a7fe-9ea0170c5e67 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.151549 Jul 28 22:29:33.227192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 101/208] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:33 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:34.247386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:34.247971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:34.255323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:34.255763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:34.256511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:34.256936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:34.389386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:34.397458 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3c820e4d-2a4d-4c0a-8b29-67253fbddea8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.153883 Jul 28 22:29:34.398049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 108/209] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:34 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:35.419677 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:35.420283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:35.426932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:35.427413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:35.428165 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:35.428609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:35.560352 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:35.567913 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-adea1f1b-89f9-4dbe-b645-0c17b6f5bada tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.151978 Jul 28 22:29:35.568490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 102/210] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:35 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:36.590214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:36.590818 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:36.597289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:36.597769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:36.598520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:36.598949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:36.724902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:36.737115 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cc72ff2e-3c23-4b5b-9fb5-d85d6706e16f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.151166 Jul 28 22:29:36.737713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 109/211] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:36 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:37.758582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:37.759190 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:37.765174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:37.765655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:37.766412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:37.766849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:37.894467 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:37.902059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-95feddfe-d442-41e2-aee7-074a3399eb0e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.147615 Jul 28 22:29:37.902612 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 103/212] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:37 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:38.924063 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:38.924705 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:38.931205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:38.931655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:38.932416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:38.933477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:38.937701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:39.069874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:39.077602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-08d29cee-5f93-4e0a-912d-d59e1c42d1d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.157618 Jul 28 22:29:39.078219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 110/213] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:38 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:40.099579 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:40.100182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:40.106240 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:40.106718 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:40.107429 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:40.108201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:40.248354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:40.258258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-50776254-eba4-4e77-ade1-3d189a08d60b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.162412 Jul 28 22:29:40.259180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 104/214] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:40 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:41.279697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:41.280304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:41.282692 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:41.288720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:41.289171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:41.289971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:41.290410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:41.425926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:41.436972 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3b983852-90ec-45a4-ac89-d3b62d9089b4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.161016 Jul 28 22:29:41.437878 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 111/215] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:41 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:42.458895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:42.459501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:42.466141 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:42.466634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:42.467445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:42.467874 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:42.594996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:42.603065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e33725af-724c-418d-933a-e24cfb863c5b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.148672 Jul 28 22:29:42.603626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 105/216] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:42 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:43.624141 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:43.624956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:43.632107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:43.632557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:43.633615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:43.634188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:43.767123 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:43.775723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-922b52da-e90a-42e7-9317-a2dee6849b39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.156245 Jul 28 22:29:43.776295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 112/217] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:43 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:44.797806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:44.798328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:44.805172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:44.805711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:44.806537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:44.806995 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:44.825919 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:44.946980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:44.954576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5836d9de-a97d-458d-9f2e-672821671f2b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.161383 Jul 28 22:29:44.955124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 106/218] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:44 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:45.974539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:45.975138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:45.981703 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:45.982148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:45.982911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:45.983336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:46.118820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:46.126556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cc549277-d9ff-4393-9d78-8f2631c24c17 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.156110 Jul 28 22:29:46.127633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 113/219] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:45 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:47.148439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:47.149045 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:47.155181 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:47.155622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:47.156381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:47.156811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:47.295529 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:47.304022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9b086ed2-c9ca-44ac-bc13-1b3016d5b4b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.159315 Jul 28 22:29:47.304732 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 107/220] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:47 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:48.324721 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:48.325369 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:48.332304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:48.332757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:48.333520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:48.333978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:48.465681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:48.474848 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e8761a6c-c371-43d6-93da-02375a2835f7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.153976 Jul 28 22:29:48.475439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 114/221] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:48 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:49.498322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:49.498962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:49.505560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:49.506013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:49.506775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:49.507210 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:49.641012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:49.649175 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9a1c5089-7dd9-4cda-b611-f3141526cbb2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.154681 Jul 28 22:29:49.649781 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 108/222] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:49 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:50.670431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:50.670983 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:50.677914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:50.678367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:50.679127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:50.679570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:50.807735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:50.815324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f092dd2a-2265-424c-a025-fefc1612dcc0 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.148865 Jul 28 22:29:50.816070 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 115/223] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:50 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:51.836236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:51.836850 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:51.842943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:51.843395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:51.844152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:51.844586 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:51.976565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:51.984118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-deb16443-c950-49de-9e09-b6d99ba6bd9d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1521 microversion: 2.1 time: 0.151714 Jul 28 22:29:51.984693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 109/224] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:51 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:53.006256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:53.006864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:53.013612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:53.014059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:53.014808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:53.015234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:53.145449 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:53.153345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-dc96d061-254b-4a9d-bbad-e8fbede36e8b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1501 microversion: 2.1 time: 0.151607 Jul 28 22:29:53.153959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 116/225] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:53 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:29:53.173355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:53.174013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:53.180753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:53.181205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:53.182058 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:53.182560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:53.316560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:53.324066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4df50e5b-1aa5-40e7-970a-130caa70ed7b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1516 microversion: 2.1 time: 0.154571 Jul 28 22:29:53.324626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 110/226] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:53 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:54.719518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:29:54.721707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:54.728904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:54.729353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:54.730154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:54.730588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:54.752710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lazy-loading 'flavor' on Instance uuid 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:29:54.861276 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e47044fa-ea5f-4c6c-a577-740d5f08757e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/action" status: 200 len: 32 microversion: 2.1 time: 0.145702 Jul 28 22:29:54.862047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 117/227] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:29:54 2022] POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:29:54.872030 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:54.872645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:54.879486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:54.879940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:54.880757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:54.881186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:55.009094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:55.016537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2f73721a-55c8-40bc-a738-29a52ef1d0e6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.148441 Jul 28 22:29:55.017105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 111/228] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:54 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:56.040039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:56.040646 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:56.048146 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:56.048601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:56.049355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:56.049811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:56.181583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:56.189072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-67fda042-d6eb-4a2c-bdff-786a4aa11d1f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.154209 Jul 28 22:29:56.189744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 118/229] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:56 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:57.210444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:57.211082 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:57.217402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:57.217899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:57.218662 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:57.219103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:57.351992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:57.359442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a58333aa-6239-4fd8-a06e-087717e3219b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.153786 Jul 28 22:29:57.359992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 112/230] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:57 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:58.380919 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:58.381545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:58.388409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:58.388857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:58.389653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:58.390094 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:58.519071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:58.527350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9f2f87fd-5c0d-4aa8-b370-34fce7ae5b27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.150317 Jul 28 22:29:58.527928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 119/231] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:58 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:29:59.549367 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:29:59.550682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:29:59.558126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:59.558576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:59.559343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:29:59.559786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:29:59.690444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:29:59.698998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ce58a0e1-3ef8-4606-aedd-bf192b6a3ec2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.153510 Jul 28 22:29:59.699595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 113/232] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:29:59 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:00.720243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:00.720860 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:00.728246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:00.728700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:00.729463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:00.729926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:00.858966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:00.866603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f20d6a57-2ea4-492d-8e3c-db0330e010a4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.150183 Jul 28 22:30:00.867180 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 120/233] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:00 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:01.888998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:01.889573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:01.897777 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:01.898227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:01.899031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:01.899598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:02.055703 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:02.064521 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c24543af-37ec-492b-a488-7176546d605a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.179435 Jul 28 22:30:02.065386 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 114/234] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:01 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:02.522967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:02.523566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:02.530097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:02.530642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:02.531462 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:02.531905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:02.555124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-31227cf4-29fa-402c-ba14-90f8916f5883 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/ips" status: 200 len: 146 microversion: 2.1 time: 0.037104 Jul 28 22:30:02.555714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 121/235] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:30:02 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:03.085153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:03.086021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:03.092644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:03.093336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:03.094626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:03.095254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:03.250989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:03.258897 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6c26d474-67be-4611-b37f-aca3e636b604 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.177982 Jul 28 22:30:03.259476 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 115/236] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:03 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:04.280277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:04.280815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:04.287715 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:04.288171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:04.288940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:04.289378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:04.424758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:04.433753 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a0033b98-887c-4fca-a18e-1106b896c477 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.157391 Jul 28 22:30:04.434339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 122/237] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:04 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:05.456940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:05.458555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:05.461328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=30 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:05.465984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:05.466599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:05.467438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:05.468366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:05.624099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:05.631656 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bea8dbca-f1fa-412a-ba96-7a067b3cc0c2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.179559 Jul 28 22:30:05.632222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 116/238] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:05 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:06.657818 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:06.658652 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:06.667790 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:06.668494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:06.669448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:06.669908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:06.897898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:06.913243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-19cb66db-5846-4cb8-a225-21acbd8e4bab tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.262737 Jul 28 22:30:06.914567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 123/239] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:06 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:07.388355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:07.389487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:07.419425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.419970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:07.436027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.438327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:07.476282 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "999412af-4829-473f-b427-ae2d3a819ab6", "device": "/dev/sdb"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:07.480437 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:07.504893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.505584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:07.506400 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.506854 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:07.547634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-38b9c07a-8c2a-4a8e-a9d9-b4870f4d5187 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/ips" status: 200 len: 152 microversion: 2.20 time: 0.164543 Jul 28 22:30:07.553057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 117/240] 10.222.0.39 () {60 vars in 1289 bytes} [Thu Jul 28 22:30:07 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/ips => generated 152 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:30:07.963478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:07.964624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:07.981090 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.981841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:07.982984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:07.984291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:08.216497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:08.347742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:08.365881 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5f2dd10d-8456-4d3d-8719-3d47831018b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.421165 Jul 28 22:30:08.382022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 118/241] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:07 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:08.397038 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:08.398254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:08.410179 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:08.414374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:08.415521 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:08.415991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:08.457098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b997eb67-394e-4503-ab12-ae984c8fa02f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "POST /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986328 Jul 28 22:30:08.459083 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 124/242] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:30:07 2022] POST /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:30:08.515984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5880bca1-8354-4b54-b412-adcc59042950 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/ips" status: 200 len: 151 microversion: 2.1 time: 0.126049 Jul 28 22:30:08.523944 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 119/243] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:30:08 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:09.310337 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f49914da-e5fd-4d86-a39c-87e96bbe2c08"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:09.313425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:09.323026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.323711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.324677 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.325112 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.391333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:09.392190 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:09.399824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.400463 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.401230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.402147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.695800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:09.704791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5b081443-0d9e-4c40-a356-2bde87882c4f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.317769 Jul 28 22:30:09.705702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 120/244] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:09 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:09.929243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:09.929825 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:09.936399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.937592 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.938991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:09.939430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:09.967947 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lazy-loading 'flavor' on Instance uuid 782b475d-87bc-47f5-9cc2-4245086dc6c4 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:30:10.061756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:10.244129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0df15182-39f6-41c1-97a8-a17b8f18e064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/action" status: 202 len: 0 microversion: 2.20 time: 0.321752 Jul 28 22:30:10.249487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 121/245] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Jul 28 22:30:09 2022] POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 22:30:10.255251 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:10.256215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:10.264948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:10.265679 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:10.266830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:10.267419 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:10.521352 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:10.529696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:10.531206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:10.532608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-46c8a43a-571b-486e-b03d-08094f47bd7a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.281817 Jul 28 22:30:10.539497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 122/246] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:10 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:10.740621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:10.741305 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:10.748685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:10.749148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:10.749992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:10.750422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:10.953630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:10.961929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9c0a4bb8-88a3-4912-9bb9-265acbec3991 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.235131 Jul 28 22:30:10.963878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 123/247] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:10 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:11.562891 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:11.564332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:11.571770 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:11.572502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:11.573549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:11.574200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:11.727996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:11.736375 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:11.740833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:11.742616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d2ac66e5-068b-46bf-9517-d0bf88e36d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.188086 Jul 28 22:30:11.743647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 124/248] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:11 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:11.984669 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:11.985279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:11.992833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:11.993282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:11.994092 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:11.994557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:12.246026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:12.260714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d27b25db-0a36-444e-8f1d-987897d0f7df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.279887 Jul 28 22:30:12.261320 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 125/249] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:11 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:12.276526 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cf58da2b-c7ec-4c18-b7e1-88552334636a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.971078 Jul 28 22:30:12.278322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 125/250] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:30:09 2022] POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments => generated 194 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:12.500795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf577e7-e038-4d43-8af7-5609091fb5b3"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:12.510340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:12.523089 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:12.523811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:12.524786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:12.525411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:12.784954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:12.786163 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:12.822942 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=30 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:12.830691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:12.832213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:12.834668 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:12.837383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:13.255168 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2ea792c5-f4dc-47cb-9262-2abf0488cb1f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779386 Jul 28 22:30:13.256897 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 126/251] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:30:12 2022] POST /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:13.274259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:13.287482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:13.293649 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:13.294541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:13.299772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:13.308403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b515594f-f6ed-4906-9b6e-33efeacbb968 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.534950 Jul 28 22:30:13.309287 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 126/252] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:12 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:13.317364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:13.322087 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:13.322930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:13.323371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:13.642489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:13.664348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b357bfc1-74d3-4a5c-91e0-db2acf339a27 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.375919 Jul 28 22:30:13.667150 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 127/253] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:13 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:14.336476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:14.337808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:14.347086 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:14.351452 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:14.352450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:14.353064 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:14.689323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:14.689976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:14.695260 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:14.698756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:14.699409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:14.700340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:14.700951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:14.704985 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:14.706837 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:14.708658 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-472a7657-343e-4943-866d-2936f235f32b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.376176 Jul 28 22:30:14.709415 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 127/254] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:14 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:14.905886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:14.916582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6e14be6c-6fd5-4d58-848e-930e13706ccd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.232557 Jul 28 22:30:14.918199 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 128/255] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:14 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:15.735328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:15.735952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:15.745987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:15.746624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:15.747669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:15.748114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:15.943413 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:15.944039 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:15.944839 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:15.957166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:15.959901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:15.962633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-df76b82e-5a5f-4419-ad8f-1e259d830b6f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.232708 Jul 28 22:30:15.963690 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 128/256] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:15 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:15.966405 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:15.967545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:15.969369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:15.970134 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:16.253237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:16.270131 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-27cb1b57-72ae-4ec9-971e-ad4ea22f3d01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.332103 Jul 28 22:30:16.271075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 129/257] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:15 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:16.985510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:16.986150 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:16.993167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:16.993646 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:16.994618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:16.995224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:17.292311 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:17.293765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:17.301102 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:17.305582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:17.308428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:17.309191 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:17.556523 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:17.566237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:17.568628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:17.569878 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8ac31d14-1e2b-4c31-82fe-3a2e781bf925 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.588318 Jul 28 22:30:17.571190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 129/258] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:16 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:17.642996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:17.650953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f43a10ce-9907-4e54-85bd-d9dea3b5a330 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.362441 Jul 28 22:30:17.651953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 130/259] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:17 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:18.577131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-275f6f72-830a-4d87-aea8-9dfc1f5129f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Action: 'create', calling method: .version_select at 0x7f743c41f8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-285734980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAqfW3EYSpV2xs+V22JDS+IMwE0p7X5wewhznYyDCo5n/omqaKjSeScLrcDmebUuwpeUDMI2hvnrq+rZyvkejzanRDzVeKpQCLdYcJjuWt+Upr30FI9HtP02cC2/GxcEw=="}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:18.598662 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:18.599277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:18.601434 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-275f6f72-830a-4d87-aea8-9dfc1f5129f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Getting quotas for project 2406f01f7b3b4941a0bcd97a68d3d510. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:18.605811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:18.605998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-275f6f72-830a-4d87-aea8-9dfc1f5129f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Getting quotas for user 866795813bc545b5a9293ca714095679 and project 2406f01f7b3b4941a0bcd97a68d3d510. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:18.606262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:18.607224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:18.607880 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:18.643889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-275f6f72-830a-4d87-aea8-9dfc1f5129f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.348072 Jul 28 22:30:18.645075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 130/260] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:30:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:18.672828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:18.673593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:18.682083 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:18.682586 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:18.683778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:18.684315 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:18.948467 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:18.962050 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:18.964787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:18.967421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:18.973870 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5f7307b0-f2b0-4ed4-9d4b-b814451b29ec tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.374972 Jul 28 22:30:18.975415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 131/261] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:18 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:19.041154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cc81dad6-1f8c-4fff-ad81-8650f2d157e8 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.372639 Jul 28 22:30:19.045669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 131/262] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:18 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:20.003420 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:20.008152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:20.027820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:20.039764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:20.040765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:20.041575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:20.068363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:20.069002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:20.077218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:20.083684 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:20.084589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:20.085036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:20.386907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:20.391274 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:20.396254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:20.397889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:20.399505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4fcdde02-9594-4c14-b129-51071ca902b7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.401748 Jul 28 22:30:20.405876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 132/263] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:19 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:20.412645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-62c3ed10-976e-4823-96e5-4ba6d025580b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.348645 Jul 28 22:30:20.421676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 132/264] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:20 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:21.424776 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:21.424776 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:21.433696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:21.433696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:21.434005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:21.434799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:21.441544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:21.442152 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:21.448602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:21.449049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:21.449836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:21.450264 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:21.642962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:21.649377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:21.651892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:21.653453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:21.654717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6361bb65-3801-423e-bbb2-1a23d053ed23 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.234525 Jul 28 22:30:21.655280 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 133/265] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:21 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:21.656957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a4dbfbde-45a9-4d22-a3bc-0efe48d487f1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.220098 Jul 28 22:30:21.657609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 133/266] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:21 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:22.678530 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:22.679122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:22.679490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:22.679670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:22.685851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:22.686295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:22.686637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:22.687059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:22.687252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:22.687490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:22.688028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:22.688693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:22.895938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:22.903875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:22.906551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:22.908141 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:22.909321 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1f110adc-4691-4e92-8982-bea13959cc50 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.234653 Jul 28 22:30:22.913828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3bbc067e-226c-49a9-aaa1-0d816fb73a96 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.238968 Jul 28 22:30:22.919229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 134/267] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:22 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:22.922100 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 134/268] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:22 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:23.935686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:23.936300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:23.937760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:23.939054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:23.948393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:23.948817 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:23.948966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:23.949645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:23.949778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:23.950783 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:23.951310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:23.951544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:24.218020 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:24.227605 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:24.229543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:24.231002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-058704de-199b-42c7-b4de-27e2b0b04f77 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.302038 Jul 28 22:30:24.232708 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 135/269] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:23 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:24.263336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:24.273628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e3cf9489-8b64-4ece-8a6b-e99a5abc4bd2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.341644 Jul 28 22:30:24.274366 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 135/270] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:23 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:25.255517 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:25.256339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:25.264358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.264793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.265584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.266019 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.295938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:25.296582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:25.317251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.319207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.320012 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.320453 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.468057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:25.476664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:25.478231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:25.479381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4445ed48-a166-41b8-bb05-8a92886e5ba4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.227830 Jul 28 22:30:25.479931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 136/271] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:25 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:25.495523 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:25.503305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1ec59255-207c-401e-b3fe-5ae6ac3552df tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1502 microversion: 2.1 time: 0.212014 Jul 28 22:30:25.503864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 136/272] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:25 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:25.525635 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f98a3d51-e36e-45d6-9924-bfd6a82d8fec"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:25.528052 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:25.533994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.534436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.535210 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.535623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.539344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:25.559170 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] HTTP exception thrown: Cannot 'attach_volume' instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 while it is in vm_state rescued Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Request method failure captured: Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/os-volume_attachments HTTP/1.1 Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 74 Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2EPQwi9LUIU2KcR-VvJEOLzgVj_DvzhxqYGxPdqGF3mhyBtTVexK0B28hZ7RtOR_nsdh4svsGv4FiHSMsIi-PlE_OhxfHhTaB3sonqLZllTwI1EjGZRoyaoBkxrxF81nzcBWHie4d1GWaqGLp_Ad_7_8aX77KoIDxcvcPQxDfvMIg Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:30:25.563223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: afbab63bf079403b8ef652422d581d25 Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {"volumeAttachment": {"volumeId": "f98a3d51-e36e-45d6-9924-bfd6a82d8fec"}} Jul 28 22:30:25.564711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Cannot 'attach_volume' instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 while it is in vm_state rescued Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'server_id': '93cb74f8-85be-4e53-82a7-ca38fd38cbf5', 'body': {'volumeAttachment': {'volumeId': 'f98a3d51-e36e-45d6-9924-bfd6a82d8fec'}}} Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:30:25.565597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 while it is in vm_state rescued Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:30:25.567577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 while it is in vm_state rescued Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Returning 409 to user: Cannot 'attach_volume' instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 while it is in vm_state rescued {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-15e61525-4c6a-41d1-833e-da131d08ff42 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043049 Jul 28 22:30:25.568926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 137/273] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:30:25 2022] POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 22:30:25.574308 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:25.574869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:25.580875 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.581328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.582137 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.583362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.651719 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0c222fa1-867c-4f89-886b-eabe49582b78 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/action" status: 202 len: 0 microversion: 2.1 time: 0.081121 Jul 28 22:30:25.652358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 137/274] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:30:25 2022] POST /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:30:25.661460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:25.662080 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:25.674274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.675042 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.675997 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:25.676555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:25.808610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:25.816215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f920e8b6-991c-4131-9f09-da615f1385d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.159523 Jul 28 22:30:25.816923 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 138/275] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:25 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:26.502769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:26.503473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:26.511014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:26.511472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:26.512243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:26.512686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:26.642667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:26.650862 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:26.652492 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:26.653701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8edf9d2c-95d5-477a-a1a2-4a4b0471167b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.155150 Jul 28 22:30:26.654277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 138/276] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:26 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:26.837496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:26.838314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:26.845105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:26.845736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:26.846719 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:26.847339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:26.981221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:26.992934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f119db65-5eda-4028-99f6-a97f1aef5b94 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.159236 Jul 28 22:30:26.993541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 139/277] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:26 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:27.676743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:27.677293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:27.683881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:27.684323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:27.685067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:27.685494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:27.689519 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:27.830621 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:27.842103 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:27.843648 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:27.844881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e0a5bc04-2b5d-400d-b1e1-c274b6b40071 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.172207 Jul 28 22:30:27.845435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 139/278] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:27 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:28.013874 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:28.014483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:28.021691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:28.022143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:28.022901 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:28.023334 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:28.154084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:28.168208 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-da265c2c-4421-40e3-b8ff-ec2fd965112f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.157989 Jul 28 22:30:28.168949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 140/279] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:28 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:28.868397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:28.869012 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:28.870946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=4 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:28.877086 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:28.877604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:28.878360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:28.878826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:29.017769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:29.027032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:29.028561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:29.029760 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-429845c9-acbb-4a85-8c9f-dcd7b3f13dd5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.165349 Jul 28 22:30:29.030324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 140/280] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:28 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:29.191166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:29.193099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:29.201386 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:29.201968 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:29.202744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:29.203180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:29.349223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:29.358110 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d6570403-9846-42c8-9e3c-60fa7c41640c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.170725 Jul 28 22:30:29.358689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 141/281] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:29 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:30.055159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:30.055714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:30.062309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:30.062772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:30.063543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:30.063981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:30.205013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:30.214145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:30.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:30.217342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4d67a816-d620-4628-ab08-2076ca874f48 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.166782 Jul 28 22:30:30.217987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 141/282] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:30 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:30.381826 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:30.382756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:30.389570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:30.390226 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:30.391482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:30.392705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:30.536522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:30.544578 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c41ac8de-c311-4927-81e2-bb72efd92cca tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.166816 Jul 28 22:30:30.545162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 142/283] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:30 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:31.243562 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:31.244073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:31.250269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:31.250720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:31.252812 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:31.252812 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:31.389799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:31.398278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:31.399808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:31.400984 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5a58cd94-6a55-436f-a170-adfaa9d7d786 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.164310 Jul 28 22:30:31.401805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 142/284] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:31 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:31.566117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:31.567123 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:31.574489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:31.574943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:31.576476 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:31.576998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:31.715391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:31.724012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0aad09d4-6a28-4386-abf8-aee88f724938 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.161730 Jul 28 22:30:31.724747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 143/285] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:31 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:32.424602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:32.425208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:32.433024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:32.433482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:32.434307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:32.434781 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:32.593474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:32.604090 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:32.607438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:32.608654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-62b6814d-d26e-4d51-bae9-6776d825c244 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.188004 Jul 28 22:30:32.609218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 143/286] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:32 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:32.745800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:32.750946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:32.759222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:32.759949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:32.760744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:32.761182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:32.950680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:32.964725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7f7dacf4-45d4-4eb7-96e8-ae41ed738c69 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.222904 Jul 28 22:30:32.965305 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 144/287] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:32 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:33.632722 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:33.633327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:33.641193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:33.641675 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:33.642444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:33.642872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:33.774636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:33.782983 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:33.784491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:33.786245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b430455d-ac9a-4859-ab55-2dfc1e7ac1d5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.158260 Jul 28 22:30:33.786997 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 144/288] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:33 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:30:33.986902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:33.987439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:33.994805 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:33.995269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:33.996051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:33.996492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:34.126172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:34.134819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bad196af-da32-412b-bdd6-74b419547fad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.151809 Jul 28 22:30:34.135390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 145/289] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:33 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:34.810212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:34.810832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:34.818389 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:34.818831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:34.819589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:34.820017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:34.969713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:34.978592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:34.980095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:34.981360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-368ed6d8-0de5-45ce-b2b4-554c974181cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.175105 Jul 28 22:30:34.989647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 145/290] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:34 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:35.156714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:35.157822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:35.166335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:35.166789 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:35.167570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:35.168015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:35.330644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:35.338627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4a1fc9ec-26c8-47ab-baf5-da243a15b86a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.186061 Jul 28 22:30:35.339187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 146/291] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:35 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:36.004467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:36.005856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:36.014884 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:36.015414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:36.016171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:36.016601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:36.173059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:36.183248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:36.184999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:36.186387 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3a83a394-991d-4491-8fd0-1bec11b3b30f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.186029 Jul 28 22:30:36.186991 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 146/292] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:35 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:36.361292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:36.361996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:36.364531 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=62 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:36.371055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:36.371842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:36.372615 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:36.373051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:36.560581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:36.568430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0fbf1507-d2f8-4dd5-9c87-9dd0230187d4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1510 microversion: 2.1 time: 0.211980 Jul 28 22:30:36.569832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 147/293] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:36 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:37.209857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:37.210570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:37.217741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:37.218300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:37.219356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:37.219855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:37.370571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:37.380027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:37.381664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:37.383118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-963250f3-277f-4946-b072-e56e45adc787 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1743 microversion: 2.20 time: 0.177363 Jul 28 22:30:37.383674 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 147/294] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:37 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:37.590426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:37.590987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:37.597967 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:37.598428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:37.599194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:37.599634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:37.742862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:37.752336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b24c3585-eafc-4343-9ede-ef3ea381b7db tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1516 microversion: 2.1 time: 0.165800 Jul 28 22:30:37.753051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 148/295] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:37 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:38.410813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:38.412029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:38.418779 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:38.419312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:38.420165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:38.420676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:38.538752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7a25d71f-b2b6-46c1-97ce-c7f083567a6b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:38.544742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7a25d71f-b2b6-46c1-97ce-c7f083567a6b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:38.545194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7a25d71f-b2b6-46c1-97ce-c7f083567a6b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:38.607482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7a25d71f-b2b6-46c1-97ce-c7f083567a6b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Going to try to stop instance {{(pid=118086) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 28 22:30:38.617767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:38.632221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:38.634142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:38.635388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-186dbda0-e68a-4833-9e01-2edfe7b8a6ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1743 microversion: 2.20 time: 0.232021 Jul 28 22:30:38.636017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 148/296] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:38 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1743 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:38.657790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7a25d71f-b2b6-46c1-97ce-c7f083567a6b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action" status: 202 len: 0 microversion: 2.1 time: 0.123233 Jul 28 22:30:38.658401 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 149/297] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:30:38 2022] POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 22:30:38.670542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:38.671388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:38.683584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:38.685005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:38.686010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:38.686795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:38.838949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:38.852126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7c966416-645b-46f0-a61e-cb82441d2da9 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.185748 Jul 28 22:30:38.852709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 149/298] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:38 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:39.203703 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-dda523d4-7bd3-4beb-b5c1-1d5f3eb50add tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: .version_select at 0x7f743c32de50>, body: {"keypair": {"name": "tempest-keypair-371941756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhMmWBZa+ZQa+wyNcD+uxwAsJRjewrGh/0pBPmvJgqFDDzFAbSaKiQH/oDOd5WVkq5AjUzAp2CBc/x/XCQRfD3rb65EbDUTN5ZFLxpXAeDaZE3zQ9FZMjUFV9/74cVODw=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:39.219739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-dda523d4-7bd3-4beb-b5c1-1d5f3eb50add tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:39.224631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-dda523d4-7bd3-4beb-b5c1-1d5f3eb50add tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for user afbab63bf079403b8ef652422d581d25 and project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:39.249186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-dda523d4-7bd3-4beb-b5c1-1d5f3eb50add tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049752 Jul 28 22:30:39.250004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 150/299] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:30:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:39.443770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:39.444264 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:39.451671 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.452049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.452825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.453454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.609309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lazy-loading 'services' on Instance uuid 82a48d55-8f82-4f28-ab27-957d404713fd {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:30:39.661630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:39.663561 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:39.672770 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.673692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.674738 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.675185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.759085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9d02c4be-28ae-4190-965f-1e153261fd4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "DELETE /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd/os-volume_attachments/999412af-4829-473f-b427-ae2d3a819ab6" status: 202 len: 0 microversion: 2.1 time: 0.320179 Jul 28 22:30:39.759966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 150/300] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:30:39 2022] DELETE /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd/os-volume_attachments/999412af-4829-473f-b427-ae2d3a819ab6 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:30:39.872564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:39.879997 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:39.880762 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:39.887955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:39.888773 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.889208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.890312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:39.890489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:39.891826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:39.894575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f7dee56c-1794-4bbd-84e4-6a4257db8ac3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1743 microversion: 2.20 time: 0.237724 Jul 28 22:30:39.914905 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 151/301] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:39 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:40.076234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:40.085340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e9caccaa-4385-4023-afdf-f8b9832fe7ca tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.210719 Jul 28 22:30:40.085960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 151/302] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:39 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:40.926499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:40.927242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:40.935241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:40.935759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:40.936596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:40.937091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:41.090455 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1044166464", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f48c6e9d-45a6-4c64-a517-0531b03b9307"}], "security_groups": [{"name": "tempest-securitygroup--209467909"}], "key_name": "tempest-keypair-371941756", "user_data": "}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:41.116480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:41.124780 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:41.126608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:41.127876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c6e2859c-7a57-4fab-8b1f-67c1ec8413e9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.207350 Jul 28 22:30:41.129112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 152/303] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:40 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:41.135968 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:41.136576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:41.143525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:41.144004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:41.145355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:41.145864 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:41.320394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] validate_networks() for [('f48c6e9d-45a6-4c64-a517-0531b03b9307', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:30:41.325942 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:41.339306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-74f20d4e-7762-41d4-88c9-fd5c19d038ea tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.208225 Jul 28 22:30:41.358527 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 153/304] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:41 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:41.845882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:30:41.846402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:30:41.847152 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:30:41.847776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:30:41.848410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:30:41.857861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:41.858423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:41.859260 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:41.859707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:41.880915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:41.885711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Getting quotas for user afbab63bf079403b8ef652422d581d25 and project 567bd0fe29da4db5a0f08c8b5cc81f9c. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:41.899660 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:30:41.902339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:30:41.964003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-427fd391-3895-47b6-bb33-57d6e9ba43d7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.879028 Jul 28 22:30:41.964648 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 152/305] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:30:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:30:41.981308 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7fee9ced-76f9-4ce9-a65c-8df04ec640c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:41.985283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7fee9ced-76f9-4ce9-a65c-8df04ec640c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:42.096216 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7fee9ced-76f9-4ce9-a65c-8df04ec640c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:42.107828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7fee9ced-76f9-4ce9-a65c-8df04ec640c7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1245 microversion: 2.1 time: 0.131885 Jul 28 22:30:42.108796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 154/306] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:41 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:42.158066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:42.158471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:42.172014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:42.172720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:42.173717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:42.174182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:42.365845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:42.369642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:42.384378 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:42.387070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:42.388017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:42.388806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:42.403327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:42.437297 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:42.448575 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:42.450741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:42.452173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4fdef89e-472d-4aaf-aaaf-e1c59c23d336 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.299065 Jul 28 22:30:42.459594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 153/307] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:42 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:42.485676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-dd771c0e-4f6c-4fc0-9efe-a4137ee05e6f req-316cf648-f10a-46a4-9160-0bf8d1991c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "name": "network-vif-plugged", "status": "completed", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:42.523856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-dd771c0e-4f6c-4fc0-9efe-a4137ee05e6f req-316cf648-f10a-46a4-9160-0bf8d1991c07 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:42.526763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-dd771c0e-4f6c-4fc0-9efe-a4137ee05e6f req-316cf648-f10a-46a4-9160-0bf8d1991c07 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:42.544817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-dd771c0e-4f6c-4fc0-9efe-a4137ee05e6f req-316cf648-f10a-46a4-9160-0bf8d1991c07 service nova] Creating event network-vif-plugged:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:30:42.556301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-dd771c0e-4f6c-4fc0-9efe-a4137ee05e6f req-316cf648-f10a-46a4-9160-0bf8d1991c07 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093173 Jul 28 22:30:42.558168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 154/308] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:42.624536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:42.637860 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-71c7817a-479b-4d2c-8567-501d36638906 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.277385 Jul 28 22:30:42.639322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 155/309] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:42 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:43.131629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:43.132795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:43.134858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:43.140732 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.141193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.142011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.142454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.216788 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:43.227431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-93b76af3-98f3-4332-83c6-cd23b1de6012 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1297 microversion: 2.1 time: 0.100161 Jul 28 22:30:43.236826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 155/310] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:43 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:43.485976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:43.492787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:43.501006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.502138 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.503076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.506391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.664706 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:43.665815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:43.673236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.674089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.676954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:43.678222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:43.702481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:44.110119 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:44.118537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-49a16530-aef4-4e23-a63a-5f0f2fcd993f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.460360 Jul 28 22:30:44.122258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 156/311] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:43 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:44.148348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:44.168736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:44.170275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:44.171430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ea9a53ca-319a-4354-ba67-9a9c1bb13d09 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.691491 Jul 28 22:30:44.171970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 156/312] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:43 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:44.258288 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:44.259606 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:44.266252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:44.266699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:44.267461 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:44.268002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:44.341758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:44.350476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d64f8959-9d25-41b7-943f-392bbac02372 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1303 microversion: 2.1 time: 0.097396 Jul 28 22:30:44.351283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 157/313] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:44 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:45.147041 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:45.147822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:45.154323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.155358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.155690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.156371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.199600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:45.200207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:45.209183 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.209979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.210956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.211597 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.430059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:45.433079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:45.439986 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:45.442005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:45.443339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9ce00223-3087-4c68-b6fa-96fdf3dcac53 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.249753 Jul 28 22:30:45.457565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b9e3933f-001a-4c00-bba9-2ab60bd976f0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.304070 Jul 28 22:30:45.457565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 157/314] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:45 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:45.457857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 158/315] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:45 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:45.463975 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:45.464731 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:45.471578 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.472750 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.473706 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:45.474144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:45.551864 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:45.559447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e32b5b6b-09a5-490a-9667-91a5da304f23 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1303 microversion: 2.1 time: 0.111757 Jul 28 22:30:45.560178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 158/316] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:45 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:46.471426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:46.472661 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:46.473598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:46.474771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:46.479261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.479714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.480484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.480913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.483241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.483943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.484941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.485608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.711599 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:46.714638 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:46.722847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:46.724943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:46.726507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bab52584-f5d7-4bd7-8e75-b833eef65c4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.259065 Jul 28 22:30:46.743303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 159/317] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:46 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:46.749621 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:46.751222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:46.759095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-339eeff4-04bd-44b3-8fe7-926a257fda3d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.290331 Jul 28 22:30:46.771076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 159/318] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:46 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:46.774116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.774116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.775555 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:46.777551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:46.854010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:46.865601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1c938f3a-b2ce-4230-9af9-0831bed3696e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1303 microversion: 2.1 time: 0.120764 Jul 28 22:30:46.866629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 160/319] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:46 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:47.562889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1731638728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-285734980", "security_groups": [{"name": "tempest-secgroup-smoke-461454863"}], "networks": [{"uuid": "7f2aa367-6d5d-4752-a99e-b9dafb11cca1"}], "block_device_mapping_v2": [{"uuid": "dfd04cd4-7732-4c09-83af-0640a2657915", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:47.755911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:47.763394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:47.775563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] validate_networks() for [('7f2aa367-6d5d-4752-a99e-b9dafb11cca1', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:30:47.782475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:47.782934 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:47.783719 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:47.785005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.141236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:48.173492 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:48.179294 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:48.185570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-47785d1c-75fa-4086-b73c-d5d05d368312 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.434067 Jul 28 22:30:48.198768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 161/320] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:47 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:48.222795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:48.224689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:48.235703 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.240021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.240992 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.247477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.523363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:48.535781 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3ea4c668-a239-4d12-b5ad-d7baa149e597 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.332582 Jul 28 22:30:48.545609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 162/321] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:48 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:48.545609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:48.545609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:48.558427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:30:48.558601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.559110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.559839 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:30:48.560525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:30:48.560677 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.561137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:30:48.561431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.561767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:30:48.589759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.589759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.589759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:48.589759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:48.611895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Getting quotas for project 2406f01f7b3b4941a0bcd97a68d3d510. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:48.617776 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Getting quotas for user 866795813bc545b5a9293ca714095679 and project 2406f01f7b3b4941a0bcd97a68d3d510. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:48.775113 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:30:48.777247 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfd04cd4-7732-4c09-83af-0640a2657915',volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:30:48.806179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:48.822815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7493ea5b-5e1b-4293-8e6b-246837f3bdf7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.284343 Jul 28 22:30:48.826842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 163/322] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:48 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:48.839301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0abe996a-c646-496f-9de1-ccb4e339f33b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: .version_select at 0x7f743c5498b0>, body: {"keypair": {"name": "tempest-keypair-196127535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr8rtGZBOKrTA3gInNbLCP7Z/w+1e/IdrEjnnl7N9yl1cnWkHknERiVRxIlXXTfJWhFYznK7ENT2yFDilZuWjdR81L9PpRL/83nAp/00QCvrIDiZgeOQWux9egJCwoRwQ=="}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:48.861918 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-0abe996a-c646-496f-9de1-ccb4e339f33b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:48.868417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-0abe996a-c646-496f-9de1-ccb4e339f33b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:48.927223 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0abe996a-c646-496f-9de1-ccb4e339f33b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098763 Jul 28 22:30:48.928200 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 164/323] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:30:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:49.046287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a1568b30-e827-4d5c-8b2f-702170f9f58f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.487340 Jul 28 22:30:49.048826 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 160/324] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:30:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:30:49.059216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6ac55b47-5810-43e0-86f2-111b1baceeab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:49.060025 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6ac55b47-5810-43e0-86f2-111b1baceeab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:49.084333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-1c5ef70e-65ab-47de-a95b-0deeff3b1ea4 req-009a35f8-43a2-420a-bbce-f98f2e927726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:49.122589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1c5ef70e-65ab-47de-a95b-0deeff3b1ea4 req-009a35f8-43a2-420a-bbce-f98f2e927726 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.125103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1c5ef70e-65ab-47de-a95b-0deeff3b1ea4 req-009a35f8-43a2-420a-bbce-f98f2e927726 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.177725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-1c5ef70e-65ab-47de-a95b-0deeff3b1ea4 req-009a35f8-43a2-420a-bbce-f98f2e927726 service nova] Creating event network-changed:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:30:49.195278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-1c5ef70e-65ab-47de-a95b-0deeff3b1ea4 req-009a35f8-43a2-420a-bbce-f98f2e927726 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126810 Jul 28 22:30:49.196440 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 161/325] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:49.216151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:49.216843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:49.232314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.232784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.233579 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.234017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.236624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6ac55b47-5810-43e0-86f2-111b1baceeab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:49.252081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6ac55b47-5810-43e0-86f2-111b1baceeab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1088 microversion: 2.1 time: 0.197152 Jul 28 22:30:49.252637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 165/326] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:49 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1088 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:49.520400 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:49.532299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:49.534013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:49.536567 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b5e2f7cf-dfd6-46da-8a02-25e9e0ffe31d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.324622 Jul 28 22:30:49.543786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 162/327] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:49 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:49.561095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:49.562169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:49.574833 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.577809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.580540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.585466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.779612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:49.788909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8b5d051d-4c43-49b8-a524-d165ffec0983 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.232223 Jul 28 22:30:49.790167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 166/328] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:49 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:49.849452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:49.850124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:49.863719 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.864230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:49.865041 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:49.865559 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.035392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:50.044725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ffb49d6c-d967-48cf-9d38-4c9374216c3d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.200324 Jul 28 22:30:50.061473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 163/329] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:49 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:50.276536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:50.277148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:50.284237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.284853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.285778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.286471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.359041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:50.369601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-45e5ebc0-30d6-491e-a503-b69f320a7de5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1138 microversion: 2.1 time: 0.096272 Jul 28 22:30:50.371029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 167/330] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:50 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:50.561819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:50.562696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:50.572108 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.572562 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.577655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.578114 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.786118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:50.795828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:50.798551 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:50.802547 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a9ce99b1-124a-4ab1-a8b2-4950ce74cac2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.244812 Jul 28 22:30:50.803697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 164/331] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:50 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:50.820606 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:50.822265 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:50.829497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.830210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.831009 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:50.831446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:50.998383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:51.009187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c8a6244b-7058-4230-9f7e-a13bd91f1ec3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.201079 Jul 28 22:30:51.011121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 168/332] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:50 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:51.042368 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-521753447", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ba94cd9-b91a-4088-b65d-e5c882850ab5"}], "security_groups": [{"name": "tempest-securitygroup--1011285395"}], "key_name": "tempest-keypair-196127535", "user_data": "}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:51.069723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:51.071126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:51.081868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.082711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.083662 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.084261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.222596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] validate_networks() for [('6ba94cd9-b91a-4088-b65d-e5c882850ab5', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:30:51.351480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:51.363791 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ce55234b-2a05-4de6-919d-acd405818c9a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.299995 Jul 28 22:30:51.377638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 169/333] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:51 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:51.396472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:51.397474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:51.416304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.417103 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.418038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.418666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.583010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:51.597492 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-934587d1-52be-4eb7-8e65-0e73fe151aee tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1138 microversion: 2.1 time: 0.206006 Jul 28 22:30:51.608611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 170/334] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:51 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1138 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:51.829352 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:51.830166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:51.842680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:30:51.843623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:30:51.844317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:30:51.844710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.844925 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:30:51.845168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.845559 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:30:51.845974 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.846403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.863271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.864498 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.867576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:51.868262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:51.883535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:51.912169 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:30:51.916657 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:30:51.929899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:30:51.932819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:30:51.986914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-23f26be5-3253-4c90-8fb2-f06f8de02534 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.948713 Jul 28 22:30:51.987791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 165/335] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:30:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:30:51.998858 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5d10b2af-f466-4205-9f0a-393f8f66f7b8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:51.999480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5d10b2af-f466-4205-9f0a-393f8f66f7b8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:52.073402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5d10b2af-f466-4205-9f0a-393f8f66f7b8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.084581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5d10b2af-f466-4205-9f0a-393f8f66f7b8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1240 microversion: 2.1 time: 0.089538 Jul 28 22:30:52.089250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 166/336] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:51 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:52.093930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:52.094539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:52.101431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.102117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.103103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.103692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.127245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.150582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.152385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.161335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a63b033c-c3f6-456d-ac6d-43a5eacbf11a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.334321 Jul 28 22:30:52.172716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 171/337] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:51 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:52.352811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.363251 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5720b006-b382-4dc0-89df-7d815f4324ed tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.272336 Jul 28 22:30:52.363832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 167/338] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:52 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:52.385881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:52.386493 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:52.400838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.401318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.402144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.402584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.632399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:52.633630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:52.643450 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.645981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.647201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:52.647856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:52.827701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.836054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-416715b8-b942-4a54-8019-ffe692644a6b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1204 microversion: 2.1 time: 0.210352 Jul 28 22:30:52.836626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 168/339] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:52 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1204 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:52.892657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:52.905391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-57dee184-1352-405e-b006-3e5ef40c9d9c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.523693 Jul 28 22:30:52.907763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 172/340] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:52 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:52.999163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:52.999989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.020996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.021358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.022167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.022778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.057079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:30:53.108893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.110465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.120970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.121550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.122436 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.122950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.187856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5bb17fdd-b335-4cf1-a711-3cc405725ca9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "DELETE /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 204 len: 0 microversion: 2.1 time: 0.193931 Jul 28 22:30:53.189163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 169/341] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:30:52 2022] DELETE /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:30:53.198575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.199706 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.207107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.207567 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.208354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.208848 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.226130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.242214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3694bcc7-9f23-46dd-bb53-a9b7dd4b4b6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1292 microversion: 2.1 time: 0.139463 Jul 28 22:30:53.243535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 173/342] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1292 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:53.248772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.249806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.256787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.257325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.258219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.258742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.438322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.449486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.451057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.452238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-47c944d6-c314-41a9-b323-e206b0a86cfb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.261724 Jul 28 22:30:53.452795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 170/343] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:53.470240 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.473091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.479131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.490978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:53.492591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1077f162-6110-4d0c-9467-5f9e7baf0c5b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.247814 Jul 28 22:30:53.493178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 174/344] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:53.498160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.498623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.499465 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.499907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.634647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:53.642680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8e03e3f4-4618-4228-a23e-ab845ad19ecc tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.187294 Jul 28 22:30:53.643252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 171/345] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:53.856642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.857374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.864682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.865068 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.865993 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.866340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.870437 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:53.930541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:53.932643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:53.946599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.947436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:53.948457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:53.949451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.047404 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.055126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-19ff6b35-dfdb-4f8f-bf8b-4c21004da6f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1271 microversion: 2.1 time: 0.202798 Jul 28 22:30:54.055697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 175/346] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:54.105765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.113161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2aedcd52-734e-486d-bcea-502acddf5d83 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.189078 Jul 28 22:30:54.113746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 172/347] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:53 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:54.264172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:54.264803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:54.271530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.271978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.272721 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.273149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.332764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.340106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f027aacf-e8e2-4e64-a7bd-5a76eb164f97 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1300 microversion: 2.1 time: 0.079864 Jul 28 22:30:54.340668 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 176/348] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:54 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:54.476484 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:54.477125 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:54.483031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.483492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.484252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.484689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.489675 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:54.514716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:54.515489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:54.522168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.522617 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.523387 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.523828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.683875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.693148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.694689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.695857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-df4c6462-e728-450b-9dbc-e62c6f038117 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.223354 Jul 28 22:30:54.696413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 173/349] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:54 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:54.700801 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:54.701407 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:54.705062 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.708658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.709113 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.709912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:54.710353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:54.713256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f4683b8f-3c37-4c5c-b54d-14cdfb547e4a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.202319 Jul 28 22:30:54.713853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 177/350] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:54 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:54.842576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:54.851725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-eed01b4a-8b96-4427-b046-fcaa6bcebef5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.154377 Jul 28 22:30:54.852285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 174/351] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:54 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:55.076173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.076708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.083783 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.084227 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.084979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.085410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.134559 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.135228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.141918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.142384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.143163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.144337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.255666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.263825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f2ec99ad-62d5-4d12-83af-04745cd136e7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1271 microversion: 2.1 time: 0.191522 Jul 28 22:30:55.264395 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 178/352] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:55.298573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.306565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c6ebe458-1d16-4d4f-9ecc-a9f7136e0b86 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.176347 Jul 28 22:30:55.307127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 175/353] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:55.360006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.360615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.367355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.367804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.368557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.368985 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.432325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.439659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1c318bbd-f9d9-4b8a-8569-be9559994c36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1300 microversion: 2.1 time: 0.083524 Jul 28 22:30:55.440827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 179/354] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:55.719713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.720276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.726909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.727365 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.728164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.728623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.735661 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.736271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.743605 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.744057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.744826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.745264 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.906670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.915289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.916813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.918009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-66cb3199-48da-4b99-bc4e-2c1f3b659e9b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.202381 Jul 28 22:30:55.918564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 176/355] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:55.923218 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:55.923830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:55.928222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:55.930064 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.930698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.931481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:55.932471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:55.936188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ac5c97b6-335b-474e-89ad-81121f891921 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.204297 Jul 28 22:30:55.936759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 180/356] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:56.064473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:56.073176 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b62b327e-5ae7-43b8-91d9-2a7335b3abd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.153673 Jul 28 22:30:56.073774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 177/357] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:55 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:56.284014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:56.284622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:56.291035 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.291487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.292248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.292695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.327720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:56.328348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:56.335723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.336172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.336934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.337366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.475428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:56.482960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7551dbbc-b872-47e3-b692-a619ed66a282 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1271 microversion: 2.1 time: 0.202941 Jul 28 22:30:56.483542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 181/358] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:56 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:56.488066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:56.488673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:56.495382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.495880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.496771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.497214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.501043 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:56.509580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fd3798dd-c9f6-4715-98af-a9a58886ad49 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.185690 Jul 28 22:30:56.510156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 178/359] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:56 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:56.558075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:56.565905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-94c9f8e7-9d2f-46c7-81b3-17acd2e696fa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1300 microversion: 2.1 time: 0.080828 Jul 28 22:30:56.566463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 182/360] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:56 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:56.943618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:56.944228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:56.951960 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.953062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.954755 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.955163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.962596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:56.963845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:56.970299 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.970999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:56.972643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:56.973349 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.213939 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.217161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.222808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6e423539-8823-4af5-a2bc-868c2b449ed4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.268226 Jul 28 22:30:57.223323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 183/361] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:56 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:57.231952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:57.232570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:57.234640 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.236264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.239661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f5d27bcb-f562-4868-b110-249b405229f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.299761 Jul 28 22:30:57.240428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 179/362] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:56 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:57.242450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.242911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.243684 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.244125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.376342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.385872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-832f1007-6f31-4e4f-935f-3803d7180e8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.161525 Jul 28 22:30:57.386471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 184/363] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:57 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:57.509846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:57.509998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:57.517289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.517863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.519464 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.519914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.530711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:57.531331 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:57.543774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.544232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.545458 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.546287 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.758750 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.766994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-97e2fdd2-325c-4371-8346-4bcbca15bfcc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.262086 Jul 28 22:30:57.767603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 180/364] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:57 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:57.773178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:57.773876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:57.781877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.788780 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.789236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.790076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.792021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.792158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d70fe79d-4c4d-47e0-989f-6f11feba8dfe tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.265184 Jul 28 22:30:57.805550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 185/365] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:57 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:57.805550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-98c406a3-762c-49d4-9cfa-908f9d227c2f req-3d241556-421f-4323-affa-c30f7ca6738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:30:57.810995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-98c406a3-762c-49d4-9cfa-908f9d227c2f req-3d241556-421f-4323-affa-c30f7ca6738a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:57.811473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-98c406a3-762c-49d4-9cfa-908f9d227c2f req-3d241556-421f-4323-affa-c30f7ca6738a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:57.823511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-98c406a3-762c-49d4-9cfa-908f9d227c2f req-3d241556-421f-4323-affa-c30f7ca6738a service nova] Creating event network-changed:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:30:57.828636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-98c406a3-762c-49d4-9cfa-908f9d227c2f req-3d241556-421f-4323-affa-c30f7ca6738a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034238 Jul 28 22:30:57.829592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 186/366] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:30:57.868775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:57.876644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2a90927d-9994-4204-b0a5-3bea0767145d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1310 microversion: 2.1 time: 0.108004 Jul 28 22:30:57.877213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 181/367] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:57 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:58.246472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:58.247179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:58.254534 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.255028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.255861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.256893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.264167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:58.264782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:58.271851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.272634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.273466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.274084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.462919 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:58.466099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:58.472480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-04dfae35-a4f9-4174-beb7-eb3d9a6c6f15 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.231632 Jul 28 22:30:58.473058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 187/368] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:58 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:58.475430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:58.476949 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:58.477734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:58.478220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b3745a0a-73d8-457a-a10d-d2f10d879d26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1738 microversion: 2.20 time: 0.217920 Jul 28 22:30:58.478329 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:58.484105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.484561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.485365 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.485829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.493726 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 182/369] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:58 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:30:58.624023 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:58.632842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-200bc785-c593-4281-8571-bcd2dbd661e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.158583 Jul 28 22:30:58.633693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 188/370] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:58 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:58.789256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:58.789924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:58.797106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.797888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.798841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.799293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.816432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:58.817136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:58.833489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.834300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.845950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:58.846618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:58.992220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.002876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ccf8b21f-fd42-4078-a834-53c95d0d47a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.216830 Jul 28 22:30:59.016474 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 183/371] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:58 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:59.016474 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:59.016474 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:59.018696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.019186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.020623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.021065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.030240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.040314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d684ef9e-5451-42e6-9d82-3e9a563b858f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.227904 Jul 28 22:30:59.041124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 189/372] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:58 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:30:59.089799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.098220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ef95fbe4-2c5a-448a-acec-6ff057276f47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1298 microversion: 2.1 time: 0.093753 Jul 28 22:30:59.098798 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 184/373] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:59 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:59.494789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:59.495312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:59.499879 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=12 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:30:59.506281 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:59.507099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:59.511538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.512007 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.517576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.517576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.517816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.517816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.517816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.517816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.701513 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.711523 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.713095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.714392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a515dc9b-e57b-478b-a8ee-1f0ff6fa7edf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.215829 Jul 28 22:30:59.726580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 185/374] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:30:59 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:30:59.731289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.736294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:30:59.737890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:30:59.744560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.745027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.745843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:30:59.746626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:30:59.755396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-68996aa7-cda3-47b2-817b-4557e46417ee tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1513 microversion: 2.1 time: 0.265965 Jul 28 22:30:59.766552 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 190/375] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:59 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:30:59.878035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:30:59.886358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7663da9a-de0f-4f4d-bf56-0358caaddc73 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.158658 Jul 28 22:30:59.886924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 186/376] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:30:59 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:00.023357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.024005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.030198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.030655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.031425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.031874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.061124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.061813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.068482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.069223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.070036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.070481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.232262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.240927 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-65ddc786-88ae-4105-bd36-8fb9ac427afb tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.221388 Jul 28 22:31:00.241505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 191/377] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:00.246546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.247083 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.253199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.253676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.254611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.255208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.260046 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.268847 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-34b79c83-5d0d-4c25-ae3c-25e9d841a966 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.211562 Jul 28 22:31:00.269485 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 187/378] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:00.274285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-bf4618e5-2abe-4f4c-8b82-70b0bd624a0b req-3974f12d-b3fd-491f-b31a-f9cdc2571dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a48d55-8f82-4f28-ab27-957d404713fd", "name": "network-vif-deleted", "tag": "8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:00.284423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bf4618e5-2abe-4f4c-8b82-70b0bd624a0b req-3974f12d-b3fd-491f-b31a-f9cdc2571dde service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.285231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bf4618e5-2abe-4f4c-8b82-70b0bd624a0b req-3974f12d-b3fd-491f-b31a-f9cdc2571dde service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.285552 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:00.297516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-bf4618e5-2abe-4f4c-8b82-70b0bd624a0b req-3974f12d-b3fd-491f-b31a-f9cdc2571dde service nova] Creating event network-vif-deleted:8ac3cf3e-ac71-4d75-a0a6-64da5ca3a9d2 for instance 82a48d55-8f82-4f28-ab27-957d404713fd on hv-cinder-85093 Jul 28 22:31:00.303456 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-bf4618e5-2abe-4f4c-8b82-70b0bd624a0b req-3974f12d-b3fd-491f-b31a-f9cdc2571dde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Jul 28 22:31:00.304759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 188/379] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:00.406764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.416017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a4f8b48b-1522-49d3-b1c6-e4819f65566e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.173271 Jul 28 22:31:00.416636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 192/380] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:00.742463 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.743248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.749575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.749960 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.750722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.751153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.779718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.780397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.788201 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.788659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.789439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.789918 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.870531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.879498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e0a56c44-c334-42d9-85fd-35c34662daeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1471 microversion: 2.1 time: 0.104761 Jul 28 22:31:00.880117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 193/381] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:00.907907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:00.908512 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:00.908766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.914699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.915140 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.915899 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:00.916326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:00.916773 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.918312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:00.919457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6367581d-4b2f-4508-9e14-fb795e028fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.181721 Jul 28 22:31:00.920009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 189/382] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:01.242613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:01.250560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cdd615c8-11f8-46c2-92e6-a582d0d66dee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.346412 Jul 28 22:31:01.251121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 194/383] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:00 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:01.263002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:01.263705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:01.269818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.270262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.271012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.271445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.288797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:01.289345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:01.289608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:01.295588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.296033 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.296795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.297224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.460961 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:01.468480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-06f0ebcf-0279-4a87-b516-23a6aaf18b9a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.209269 Jul 28 22:31:01.473594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 190/384] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:01 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:01.473914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:01.475160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:01.475760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:01.481218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0ac31b5f-9648-4312-a293-dbc2c0e20f55 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.196282 Jul 28 22:31:01.481672 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.482126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.482958 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.483399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.486198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 195/385] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:01 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:01.609903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:01.618133 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b06c4a34-9156-4fe2-a736-467c030dd8ad tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.148036 Jul 28 22:31:01.618692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 191/386] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:01 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:01.900290 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:01.900895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:01.907528 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.907968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.909448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.909949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.941764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:01.942390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:01.944692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=4 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:01.950343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.951020 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.951804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:01.952247 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:01.972212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:01.979784 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4554a80e-431f-4037-adc3-4b1d1812fbc5 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1471 microversion: 2.1 time: 0.083397 Jul 28 22:31:01.980355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 196/387] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:01 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:02.081767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=20 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:02.086509 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.095087 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.098105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.099249 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4b96648a-3ef9-47f5-a752-03529ea2e13d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.161610 Jul 28 22:31:02.099830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 192/388] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:01 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:02.273829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:02.274434 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:02.280589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.281015 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.281790 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.282219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.411788 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.419682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a5bda688-1740-4678-b28d-4e31236d7c4a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.149757 Jul 28 22:31:02.420252 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 197/389] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:02 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:02.489899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:02.490547 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:02.496652 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.497116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.497913 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.498357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.502110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:02.502715 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:02.509597 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.510038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.510913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.511227 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.744581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.755567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c7b1f2f9-38ea-4849-997d-6fbea7d4426e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.257322 Jul 28 22:31:02.757383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 198/390] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:02 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:02.767689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:02.768345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:02.770365 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:02.780102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.780553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.781324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:02.782005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:02.848501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.859987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-79699480-8ed2-4c98-8110-07188db1c13d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.374620 Jul 28 22:31:02.875084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 193/391] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:02 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:02.962601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:02.970191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-654a11ef-289c-49d2-9dc8-b98688bd7023 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.212801 Jul 28 22:31:02.970768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 199/392] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:02 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:03.000755 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:03.001355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:03.009119 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.009605 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.010374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.010816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.046163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.046616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.047156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lazy-loading 'fault' on Instance uuid 82a48d55-8f82-4f28-ab27-957d404713fd {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:31:03.094151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.103536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6773c55d-1756-4a14-8396-179987ce8092 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 200 len: 1308 microversion: 2.1 time: 0.107004 Jul 28 22:31:03.104233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 194/393] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:02 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:03.123826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:03.124477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:03.132483 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.133021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.134067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.134595 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.310348 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.320469 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.322326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.323536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5017eca0-d8ba-43a9-8cb9-58f467964b3e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.205192 Jul 28 22:31:03.324101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 200/394] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:03 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:03.444134 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:03.444764 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:03.451550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.452009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.452993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.453443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.606594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.616309 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9aabc264-9929-4139-a771-4030fcab7f5d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.178155 Jul 28 22:31:03.617345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 195/395] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:03 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:03.776250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:03.776984 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:03.786289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.786289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.787247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.787779 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.884934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:03.886060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:03.898152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.901044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.901963 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.902333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:03.958768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:03.967378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-90f10f25-ba88-4c85-b731-578309f88ee7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.194740 Jul 28 22:31:03.977663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 201/396] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:03 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:03.977663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-59ffc88d-c121-43d8-8300-9ba34c837fe4 req-0f121702-892c-46bf-9862-0689813f4441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5606c87-43fb-42b9-b876-929d94fff6bb", "tag": "7264386b-d8eb-4240-9b23-13c3bbbc0ba3"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:03.994212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-59ffc88d-c121-43d8-8300-9ba34c837fe4 req-0f121702-892c-46bf-9862-0689813f4441 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:03.994682 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-59ffc88d-c121-43d8-8300-9ba34c837fe4 req-0f121702-892c-46bf-9862-0689813f4441 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.008076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-59ffc88d-c121-43d8-8300-9ba34c837fe4 req-0f121702-892c-46bf-9862-0689813f4441 service nova] Creating event network-changed:7264386b-d8eb-4240-9b23-13c3bbbc0ba3 for instance c5606c87-43fb-42b9-b876-929d94fff6bb on hv-cinder-85093 Jul 28 22:31:04.014122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-59ffc88d-c121-43d8-8300-9ba34c837fe4 req-0f121702-892c-46bf-9862-0689813f4441 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044315 Jul 28 22:31:04.015138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 202/397] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:04.020913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:04.021794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:04.028587 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.029045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.030079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.031242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.061647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.070493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a62fab6c-cc28-4ceb-a441-b139c1c9299a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.190205 Jul 28 22:31:04.085298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 196/398] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:03 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:04.129114 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:04.129935 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 82a48d55-8f82-4f28-ab27-957d404713fd] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:04.136716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.137555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.138470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.138918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.153835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] HTTP exception thrown: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Request method failure captured: Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd HTTP/1.1 Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w238bvu95X4wyzPueBWV8AR3WYcM4gWLf17_mAKC-8Mhnu2z4ZEKyQVFCwV22wQfDKU3CzZ2k1XtO2n_K0tuhtcSNRwusxlLVgsaBIXHC4appO29cCGVPeK_RkJuPDl2ihCh8OYNCFns_BYLedpOZmYNmaNPPbTEccbNGjp7nhxPTc Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: da5c439035bf4fe1bcf123752ab0566f Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:31:04.156071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: da5c439035bf4fe1bcf123752ab0566f Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesSnapshotTestJSON-1350472687-project Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 9d5b147068c2491c9e4c95bbf5d0cbdd Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesSnapshotTestJSON-1350472687-project Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. Jul 28 22:31:04.157686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '82a48d55-8f82-4f28-ab27-957d404713fd'} Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:31:04.158548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. Jul 28 22:31:04.160321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:31:04.162130 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Returning 404 to user: Instance 82a48d55-8f82-4f28-ab27-957d404713fd could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:31:04.162130 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5f075fc2-b3b2-45b4-81e6-985ccfd3058b tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd" status: 404 len: 111 microversion: 2.1 time: 0.033111 Jul 28 22:31:04.162130 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 197/399] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:04 2022] GET /compute/v2.1/servers/82a48d55-8f82-4f28-ab27-957d404713fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:31:04.172887 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.183359 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c643d10f-b24f-4bfc-af74-d3621980c8b1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.167054 Jul 28 22:31:04.188648 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 203/400] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:04 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:04.348371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:04.349148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:04.355241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.355696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.356462 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.356914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.487609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.495643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.497167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.498349 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-64bdbf8f-976e-4d69-bb79-93b3bc800191 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.154894 Jul 28 22:31:04.498907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 198/401] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:04 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:04.639374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:04.641844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:04.647776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.648230 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.649013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.649518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.670068 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-f638571a-0c58-48d5-9892-64623e8809aa req-d723df04-178f-4f4b-b2cd-56463d7901a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "name": "network-vif-plugged", "status": "completed", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:04.680835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f638571a-0c58-48d5-9892-64623e8809aa req-d723df04-178f-4f4b-b2cd-56463d7901a2 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.681264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f638571a-0c58-48d5-9892-64623e8809aa req-d723df04-178f-4f4b-b2cd-56463d7901a2 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.697884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-f638571a-0c58-48d5-9892-64623e8809aa req-d723df04-178f-4f4b-b2cd-56463d7901a2 service nova] Creating event network-vif-plugged:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:31:04.702716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-f638571a-0c58-48d5-9892-64623e8809aa req-d723df04-178f-4f4b-b2cd-56463d7901a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036819 Jul 28 22:31:04.704079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 199/402] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:04.785018 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:04.793107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f2372aaf-03f1-4e02-9f39-d13d2079a85d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.157930 Jul 28 22:31:04.793895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 204/403] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:04 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:04.991078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:04.991789 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:04.998315 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:04.998778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:04.999650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.000105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.094246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:05.095996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:05.103380 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.104044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.105001 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.105657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.150800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.161386 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-af18e7ef-a41b-45bc-b5d6-1abb253aa641 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.174565 Jul 28 22:31:05.162004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 200/404] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:04 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:05.209938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:05.210556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:05.219569 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.220388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.221895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.222448 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.248639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.256305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4c1558f7-e35d-41e9-ba9a-3605e4f9c0a7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.167633 Jul 28 22:31:05.257132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 205/405] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:05 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:05.352506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.360017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6d46222b-e629-4af6-ba26-858df372eebb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.154033 Jul 28 22:31:05.370445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 201/406] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:05 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:05.520304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:05.520946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:05.526962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.527408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.528164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.528597 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.654645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.663183 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.664699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.665905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c80611a3-12ee-47d2-9616-fea178314607 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.149585 Jul 28 22:31:05.666473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 206/407] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:05 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:05.814932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:05.815553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:05.821636 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.822094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.822861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:05.823306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:05.953901 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:05.962078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a00697da-882e-4305-aaaa-98fc9d2c7dad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.150998 Jul 28 22:31:05.962647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 202/408] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:05 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:06.182624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:06.183241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:06.189269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.189981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.190749 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.191187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.277236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:06.277887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:06.285835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.286293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.287067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.287506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.320544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.328011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a5f7eb0c-6d26-4ad1-91a0-34687683e54a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.149247 Jul 28 22:31:06.328589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 207/409] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:06 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:06.381855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:06.382577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:06.388859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.389304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.390104 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.390527 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.420257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.428572 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c244832f-98a7-41e0-8b54-b76e1289cff5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.155121 Jul 28 22:31:06.429147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 203/410] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:06 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:06.521478 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.528908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6ccdefff-ecb3-492f-b26e-274cae713c02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.151505 Jul 28 22:31:06.529477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 208/411] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:06 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:06.688904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:06.689472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:06.695687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.696135 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.696894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.697327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.732743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-673207a8-17a4-4108-be54-82863a944a77 req-ee50cfc5-b943-4307-8416-3a997906302e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "name": "network-vif-unplugged", "status": "completed", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:06.742938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-673207a8-17a4-4108-be54-82863a944a77 req-ee50cfc5-b943-4307-8416-3a997906302e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.743470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-673207a8-17a4-4108-be54-82863a944a77 req-ee50cfc5-b943-4307-8416-3a997906302e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.755309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-673207a8-17a4-4108-be54-82863a944a77 req-ee50cfc5-b943-4307-8416-3a997906302e service nova] Creating event network-vif-unplugged:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:31:06.761153 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-673207a8-17a4-4108-be54-82863a944a77 req-ee50cfc5-b943-4307-8416-3a997906302e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032115 Jul 28 22:31:06.761874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 209/412] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:06.828395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.837459 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.839112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:06.840277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cd2127d7-4ec8-45c2-8c91-70abc7d96064 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.155380 Jul 28 22:31:06.840836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 204/413] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:06 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:06.983740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:06.984387 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:06.990798 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.991242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:06.991995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:06.992426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.010666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:07.126355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:07.135198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-03a95231-cd2f-4a91-aa4a-7bc8ee5f4049 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.155727 Jul 28 22:31:07.135767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 210/414] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:06 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:07.349536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:07.350235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:07.356768 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.357214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.357999 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.358433 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.449613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:07.450246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:07.457334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.457909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.458755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.459261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.495377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:07.503233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1a5171ce-1db7-4623-8635-d5884236f863 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.157544 Jul 28 22:31:07.504533 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 205/415] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:07 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:07.553028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:07.553691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:07.559934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.560392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.561162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.561635 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.663949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:07.676295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5e29c6cc-f56a-473e-8b1b-46682ee4216f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.226270 Jul 28 22:31:07.691804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 211/416] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:07 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:07.741228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:07.748953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6d1a04a1-d924-4b72-b18b-cc6e916fbb0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.203461 Jul 28 22:31:07.749510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 206/417] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:07 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:07.863890 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:07.864517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:07.871901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.872345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:07.873097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:07.873542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.000583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.009513 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.011140 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.012281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4ec05d57-f573-4431-9d20-6b8f65ae93e0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.152861 Jul 28 22:31:08.012909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 212/418] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:07 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:08.156169 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:08.157164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:08.163566 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.164018 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.164784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.165227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.296846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.305431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-985d876e-e473-4c19-912d-ce828b386bad tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.153132 Jul 28 22:31:08.306022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 207/419] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:08 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:08.524089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:08.524702 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:08.530867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.531315 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.532076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.532515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.667696 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.675416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e05e2d0a-6e5f-4beb-8f9a-d4652907d996 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.155130 Jul 28 22:31:08.675966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 213/420] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:08 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:08.700606 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:08.701227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:08.708485 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.708942 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.709894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.710341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.716746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:08.771113 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:08.771634 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:08.777666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.778118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.778876 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:08.779310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:08.885677 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.893987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7d90155c-a853-4b31-802b-de747a09e304 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.197156 Jul 28 22:31:08.894653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 208/421] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:08 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:08.929057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:08.936618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2642421a-1a5f-42f2-a441-ddbdaa17444a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.170008 Jul 28 22:31:08.937188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 214/422] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:08 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:09.035024 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:09.035570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:09.041595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.042052 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.042817 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.043265 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.171435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:09.179720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:09.181245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:09.182437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2d3b9fcc-5cb9-456b-8e8c-ed6a0b6e0c4d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.151427 Jul 28 22:31:09.182992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 209/423] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:09 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:09.326844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:09.327379 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:09.334162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.334616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.335384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.335824 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.464121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:09.472068 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8d8d1605-cbe7-47ee-99cc-b0c3391e3f2c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.149261 Jul 28 22:31:09.472645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 215/424] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:09 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:09.696707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:09.697329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:09.703597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.704199 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.704809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.705473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.832104 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:09.839507 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a1f97f0f-cbad-40a1-9b69-9571dff1a347 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.146734 Jul 28 22:31:09.840062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 210/425] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:09 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:09.915515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:09.916119 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:09.922654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.923094 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.924470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.924910 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.957536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:09.958222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:09.964444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.964899 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:09.965713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:09.966178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.103631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.111467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5c416c50-7192-4c74-aa1c-b7467751d218 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.199803 Jul 28 22:31:10.112041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 216/426] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:09 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:10.132057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.139560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-743facda-2d8a-4133-8edf-73d1dff069bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.186267 Jul 28 22:31:10.140147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 211/427] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:09 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:10.206528 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:10.207144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:10.213222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.213654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.214422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.214859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.347934 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.355867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.357404 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.358578 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5438b47f-f807-46d8-a468-ddf5db2a18a2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1720 microversion: 2.20 time: 0.156592 Jul 28 22:31:10.359133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 217/428] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:10 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:10.493047 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:10.493611 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:10.499681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.500133 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.500889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.501327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.634689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:10.647196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4d1191ae-44ee-41ea-8f66-cffd8ec39c94 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1724 microversion: 2.1 time: 0.157288 Jul 28 22:31:10.648752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 212/429] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:10 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:10.860678 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:10.861798 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:10.868065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.868513 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:10.869266 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:10.869820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.001017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.009455 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-da6960d4-e326-44d3-a512-e4474ec77813 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.152746 Jul 28 22:31:11.010114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 218/430] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:10 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:11.132574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:11.133187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.140982 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.141455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.142262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.143361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.170452 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:11.171463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.179803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.180800 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.182008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.182452 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.384200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.395667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.396274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ad20b8f0-b6cc-4f1d-b0f5-d26ba3f46e04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.267710 Jul 28 22:31:11.397471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 213/431] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:11 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:11.404040 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-30b9a7ec-c7e7-471d-96c9-09b511bbdb7c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.245954 Jul 28 22:31:11.404200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:11.404890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.411238 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 219/432] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:11 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:11.412189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.412836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.413710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.414243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.551107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.559120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.560628 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.561809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-077d8352-5a7c-4b9c-a827-60de792e5f59 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1723 microversion: 2.20 time: 0.162786 Jul 28 22:31:11.562370 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 214/433] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:11 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:11.584714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abfdd6b9-bc1b-4bd9-8a17-7f164b420815"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:11.587560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.593831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.594284 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.595059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.595516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.669595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:11.670213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.676255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.676892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.677692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.678139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.822233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:11.830825 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fed64d34-3dc7-4555-9e70-6c037247020c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1701 microversion: 2.1 time: 0.164852 Jul 28 22:31:11.831451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 215/434] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:11 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:11.852692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b18330ed-2030-4d52-a4e5-c2da8f4b9efe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:11.859202 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b18330ed-2030-4d52-a4e5-c2da8f4b9efe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.859661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b18330ed-2030-4d52-a4e5-c2da8f4b9efe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.886346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b18330ed-2030-4d52-a4e5-c2da8f4b9efe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Going to try to start instance {{(pid=118086) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 28 22:31:11.920044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-28cf4018-be47-498e-96f4-809b517fa704 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339639 Jul 28 22:31:11.920968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 220/435] 10.222.0.39 () {62 vars in 1364 bytes} [Thu Jul 28 22:31:11 2022] POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:31:11.943697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b18330ed-2030-4d52-a4e5-c2da8f4b9efe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action" status: 202 len: 0 microversion: 2.1 time: 0.094656 Jul 28 22:31:11.948623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 216/436] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:31:11 2022] POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 22:31:11.954361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:11.954973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:11.963711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.964356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:11.966469 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:11.967280 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.030760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:12.031461 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:12.038350 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.038803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.039579 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.040012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.142880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.152237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-aa44484d-b0f4-48a9-bf8f-84ab0bc971fe tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.203362 Jul 28 22:31:12.152909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 221/437] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:11 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:12.158759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:12.159550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:12.165817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.166272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.167045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.167623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.200775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.208543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7b22d981-e94b-4b2e-88ca-6ba1e82f88de tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.182215 Jul 28 22:31:12.209115 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 217/438] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:12 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:12.213787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118085) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 28 22:31:12.290816 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0d3d0a24-1038-4adb-9da0-12508262ea54 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/action" status: 202 len: 0 microversion: 2.20 time: 0.136378 Jul 28 22:31:12.294465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 222/439] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Jul 28 22:31:12 2022] POST /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:31:12.300521 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:12.304939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:12.319000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.319799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.320921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.321645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.418072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:12.418679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:12.425931 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.430069 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.431737 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.432701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.459965 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:12.482057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.495774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.497276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.498475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-01141024-c14b-4c56-a0b7-1ef9760d7ab7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1809 microversion: 2.20 time: 0.202605 Jul 28 22:31:12.503834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 218/440] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:12 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:12.508747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:12.514440 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:12.527412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.528085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.529394 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:12.530015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:12.666945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.677160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-425674fb-f4d9-4414-8623-c3c9e1c2d1a8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.262810 Jul 28 22:31:12.678261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 223/441] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:12 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:12.715673 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:12.725424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9b0e2784-ef62-439c-8339-bc246b4b1faf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.220173 Jul 28 22:31:12.731812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 219/442] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:12 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:13.175664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:13.176106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:13.182852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.183330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.184093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.184520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.229864 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:13.233795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:13.237823 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:13.242395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.243056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.244053 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.244647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.397065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.406723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2af21c0e-5ce0-444f-99fd-330aa6c55cf3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.235637 Jul 28 22:31:13.407579 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 224/443] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:13 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:13.425487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.433063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-13f664e3-dfa5-4509-8bdc-23f56b8fc0f4 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.207143 Jul 28 22:31:13.433649 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 220/444] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:13 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:13.526106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:13.526711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:13.532734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.534196 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.534961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.535397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.665239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.673617 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.676259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.677403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a1a02497-137f-43df-a28e-611710acdb01 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1809 microversion: 2.20 time: 0.155213 Jul 28 22:31:13.678021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 225/445] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:13 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:13.702560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:13.703202 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:13.710084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.710539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.711310 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.711749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.746697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:13.747310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:13.753547 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.754013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.754794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:13.755240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:13.890854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.899044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-03e10d90-f0dd-4e79-9e93-952236f0cc24 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.200287 Jul 28 22:31:13.899628 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 221/446] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:13 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:13.920202 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:13.927880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ea6c0447-d6f7-4a8b-b468-b64cdfa67645 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.184836 Jul 28 22:31:13.928380 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 226/447] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:13 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:14.428391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:14.429018 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:14.435085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.435535 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.436287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.436715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.454410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:14.455696 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:14.462259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.462695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.463449 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.463873 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.637181 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:14.643683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:14.649184 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-590302fa-9719-4e2b-b587-2c8c7e3330df tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.223948 Jul 28 22:31:14.649184 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 222/448] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:14 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:14.659993 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0128b3de-32af-4a6d-b368-3a1db80c178c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1370 microversion: 2.1 time: 0.209296 Jul 28 22:31:14.660562 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 227/449] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:14 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:14.700154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:14.700714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:14.707217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.707666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.708415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.708849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.839347 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:14.842727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:14.848642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:14.850180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:14.851324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4606b419-1a09-448d-a660-ca2f208777cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1809 microversion: 2.20 time: 0.155152 Jul 28 22:31:14.851878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 223/450] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:14 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:14.920772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:14.921414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:14.928205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.928649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.929396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.929853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.948180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:14.948797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:14.956827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.957199 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:14.957997 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:14.958436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.138012 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:15.156779 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-573f8f19-33e6-49f9-96b9-1098767e9ddf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.240077 Jul 28 22:31:15.158177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 228/451] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:14 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:15.167989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:15.176113 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f9d8e5de-502b-4b0b-b043-5b6e64868130 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.231101 Jul 28 22:31:15.176692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 224/452] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:14 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:15.670501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:15.671032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:15.677746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.678193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.678951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.679381 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.680314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:15.680941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:15.687182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.687629 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.688384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.688818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.875144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:15.878411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:15.883822 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6a258a5e-88fa-4af3-a86e-39fd871396ab tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.217265 Jul 28 22:31:15.884406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 229/453] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:15 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:15.893698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-18106558-c6e9-4191-8aee-4abe27c38884 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1565 microversion: 2.1 time: 0.210125 Jul 28 22:31:15.893698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 225/454] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:15 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1565 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:15.893930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:15.893930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:15.895470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.895915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.896663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.897093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.906858 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:15.907353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:15.914453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.914916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:15.915684 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:15.916124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.024272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6e81110f-2746-464e-918f-69775c3df893 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121107 Jul 28 22:31:16.024863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 226/455] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:31:15 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:16.060973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:16.069553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:16.071048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:16.072219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-83fe4782-08e3-4c76-9edc-1fd16052c7f6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1749 microversion: 2.20 time: 0.186913 Jul 28 22:31:16.072780 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 230/456] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:15 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1749 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:16.181995 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:16.183883 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:16.196086 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.196543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.197333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.197797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.199410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:16.200228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:16.215561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.219303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.222727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.224345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.434749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:16.443591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f3b0c7cc-2ed7-4192-9b11-a0ac9ef3d1a3 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.269101 Jul 28 22:31:16.444516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 227/457] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:16 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:16.448992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-580297702", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "networks": [{"uuid": "7afec142-10eb-4a87-a472-31d060e69e64"}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:16.451485 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:16.464139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e482108c-d1d9-462d-87c9-4286494f10bf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.270830 Jul 28 22:31:16.465282 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 231/458] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:16 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:16.513741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] validate_networks() for [('7afec142-10eb-4a87-a472-31d060e69e64', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:31:16.871443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:31:16.872018 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:31:16.872367 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:31:16.872781 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:31:16.873198 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:31:16.883434 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.883890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.884699 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.885143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.902294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Getting quotas for project da5c439035bf4fe1bcf123752ab0566f. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:31:16.906511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:16.907000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Getting quotas for user 9d5b147068c2491c9e4c95bbf5d0cbdd and project da5c439035bf4fe1bcf123752ab0566f. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:31:16.907389 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:16.915558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.916089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.916923 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:16.917583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:16.920116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:31:16.922466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:31:16.973746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8013559d-4cd6-4202-afd1-bf718994a34f tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527804 Jul 28 22:31:16.974410 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 228/459] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:31:16.985008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e1494802-7406-47c5-8381-b14cd47741eb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:16.985679 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e1494802-7406-47c5-8381-b14cd47741eb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:17.063813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e1494802-7406-47c5-8381-b14cd47741eb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.076821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e1494802-7406-47c5-8381-b14cd47741eb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1218 microversion: 2.1 time: 0.095115 Jul 28 22:31:17.077833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 229/460] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:16 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:17.096576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:17.098055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:17.106418 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.106993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.107798 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.108242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.117265 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.128016 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9afb4336-72f9-43a6-8cb7-4d339128c6da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.225311 Jul 28 22:31:17.129350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 232/461] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:16 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:17.264700 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.278659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.280286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.281583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b17cf2e7-d023-4489-ba7f-4303ef3ee028 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1751 microversion: 2.20 time: 0.189694 Jul 28 22:31:17.282810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 230/462] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:17 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:17.465073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:17.465829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:17.473574 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.474443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.475502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.476135 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.486713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:17.487336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:17.515839 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.516351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.522219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.522708 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.890838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.899419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2e971741-d35e-434c-9b5f-59e7bb08c3f5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.438351 Jul 28 22:31:17.914208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 233/463] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:17 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:17.919014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-95bdeb87-8a5f-41dc-96d4-4e80c1885abc req-f50c56f0-010c-4b8b-9f02-bb48aee62abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:17.930748 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-95bdeb87-8a5f-41dc-96d4-4e80c1885abc req-f50c56f0-010c-4b8b-9f02-bb48aee62abe service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:17.931423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-95bdeb87-8a5f-41dc-96d4-4e80c1885abc req-f50c56f0-010c-4b8b-9f02-bb48aee62abe service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:17.940254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:17.947028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-95bdeb87-8a5f-41dc-96d4-4e80c1885abc req-f50c56f0-010c-4b8b-9f02-bb48aee62abe service nova] Creating event network-changed:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:31:17.952468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-95bdeb87-8a5f-41dc-96d4-4e80c1885abc req-f50c56f0-010c-4b8b-9f02-bb48aee62abe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Jul 28 22:31:17.957160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b2433d83-1aa2-4f43-af36-a3d75f6581d5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.473493 Jul 28 22:31:17.958067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 234/464] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:17.964682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 231/465] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:17 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:18.103991 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:18.104697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:18.111080 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.111533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.114041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.114665 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.158730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:18.159882 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:18.167522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.168268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.169246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.169990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.217604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:18.227991 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-98d3ab20-8ada-40f5-b3be-494b3a123967 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1214 microversion: 2.1 time: 0.127911 Jul 28 22:31:18.228599 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 235/466] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:18 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:18.305156 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:18.306127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:18.312322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.312838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.313709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.314210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.366991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:18.375880 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5478bf8b-4715-429f-afa6-5c2de7b6bef1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.221912 Jul 28 22:31:18.376654 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 232/467] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:18 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:18.733894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:18.745272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:18.758497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:18.759844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e7a0abd5-5f8e-473a-816b-ed0d8f0cb35d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1751 microversion: 2.20 time: 0.459348 Jul 28 22:31:18.773697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 236/468] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:18 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1751 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:18.927168 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:18.928128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:18.945824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.946478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.947146 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.947575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.980003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:18.981231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:18.989807 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:18.996731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:18.999248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.000413 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.342795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:19.356969 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e5b2a466-01cf-4576-b65f-092c7c35d63e tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.439786 Jul 28 22:31:19.357591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 233/469] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:18 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:19.370171 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:19.372300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:19.387723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.388610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.389666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.395811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.405897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:19.422448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a4e71e27-c20a-4195-acc7-8e955486766e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.445960 Jul 28 22:31:19.425107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 237/470] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:18 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:19.439222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:19.442743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:19.462952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.464611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.465870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.466808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.683488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:19.692333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-01a11f0e-e11b-43cb-b91a-0239bf8109d0 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1278 microversion: 2.1 time: 0.332528 Jul 28 22:31:19.693068 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 234/471] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:19 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:19.729731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:19.740310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ba93199d-4967-4cb7-b01a-e6fffbffa6b7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.313989 Jul 28 22:31:19.753612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 238/472] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:19 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:19.801513 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:19.802296 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:19.809327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.810542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.811660 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:19.812112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:19.994877 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:20.008692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:20.010532 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:20.011697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e5db97c2-98bd-4bde-b660-c3a95ed60afd tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.215058 Jul 28 22:31:20.012250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 235/473] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:19 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:20.380560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:20.381565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:20.388883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.389335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.390158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.390644 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.447725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:20.448335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:20.458834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.459283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.464596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.465105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.661337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:20.670665 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4df447f8-451e-4612-bb02-f3e1179406c1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.227224 Jul 28 22:31:20.671245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 236/474] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:20 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:20.713059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:20.717895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:20.718510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:20.725258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-55dfae24-77ec-4baa-8429-7abf78312fcf tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.349123 Jul 28 22:31:20.725870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 239/475] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:20 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:20.742555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.743222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.744151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.744739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.769664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:20.771357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:20.781267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.782576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:20.786686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:20.787687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.035813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.048448 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-94b820c8-eb6a-46dc-a819-6a19a643d179 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.338317 Jul 28 22:31:21.050401 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 237/476] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:20 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:21.072555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:21.073930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:21.083627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.084321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.085910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.086316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.086845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.090615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:21.098402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b0593e56-da0e-44a3-bfd0-88e78bed9d8b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1710 microversion: 2.1 time: 0.333991 Jul 28 22:31:21.099165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 240/477] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:20 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1710 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:21.200746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-7282de4d-24af-4cbb-bbf4-894f2bdf9a64 req-184598e7-9ab9-4e4d-928b-f8f5ba2799c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:21.212907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-7282de4d-24af-4cbb-bbf4-894f2bdf9a64 req-184598e7-9ab9-4e4d-928b-f8f5ba2799c5 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.220227 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-7282de4d-24af-4cbb-bbf4-894f2bdf9a64 req-184598e7-9ab9-4e4d-928b-f8f5ba2799c5 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.244262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-7282de4d-24af-4cbb-bbf4-894f2bdf9a64 req-184598e7-9ab9-4e4d-928b-f8f5ba2799c5 service nova] Creating event network-vif-plugged:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:31:21.260254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-7282de4d-24af-4cbb-bbf4-894f2bdf9a64 req-184598e7-9ab9-4e4d-928b-f8f5ba2799c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065891 Jul 28 22:31:21.260914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 241/478] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:21.289689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.299718 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.303440 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.304838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c40cf330-521b-4e52-90ca-e54a02b27fce tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.240515 Jul 28 22:31:21.305593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 238/479] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:21 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:21.693794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:21.694514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:21.700904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.701364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.702216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.702667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.747530 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:21.748492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:21.755993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.757010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.758444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:21.758942 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:21.924179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.934809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-51b2ed63-20d5-455f-88e4-d0f284ece7b5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.245839 Jul 28 22:31:21.935778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 242/480] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:21 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:21.949875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:21.958319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f05a686b-fd76-4269-9d47-fb218497842d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.214828 Jul 28 22:31:21.958911 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 239/481] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:21 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:22.079435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:22.081083 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:22.089490 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.089982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.090743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.091345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.119922 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:22.120533 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:22.129351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.129827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.130595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.131025 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.347655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:22.350646 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:22.357443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7fb902ae-5dfa-4f8e-aa2d-1107f39167d8 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.284533 Jul 28 22:31:22.358849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-91c52d2a-e7b2-4785-9342-027d02016592 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1714 microversion: 2.1 time: 0.242570 Jul 28 22:31:22.359309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 243/483] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:22 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:22.359451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 240/483] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:22 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1714 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:22.379757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:22.380375 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:22.389815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.389815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.389815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.389815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.521787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-14b3ee75-3390-4d77-9949-bf7b6f65fcaf req-73eb3ae9-fe74-4683-a1a7-7ed201ef6ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9801b94a-6893-4344-8e6e-515696709595", "tag": "4c1a96a3-47cd-47cc-b876-541c3e717ee5"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:22.546450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-14b3ee75-3390-4d77-9949-bf7b6f65fcaf req-73eb3ae9-fe74-4683-a1a7-7ed201ef6ebb service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.546996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-14b3ee75-3390-4d77-9949-bf7b6f65fcaf req-73eb3ae9-fe74-4683-a1a7-7ed201ef6ebb service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.559046 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-14b3ee75-3390-4d77-9949-bf7b6f65fcaf req-73eb3ae9-fe74-4683-a1a7-7ed201ef6ebb service nova] Creating event network-changed:4c1a96a3-47cd-47cc-b876-541c3e717ee5 for instance 9801b94a-6893-4344-8e6e-515696709595 on hv-cinder-85093 Jul 28 22:31:22.563794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-14b3ee75-3390-4d77-9949-bf7b6f65fcaf req-73eb3ae9-fe74-4683-a1a7-7ed201ef6ebb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053411 Jul 28 22:31:22.566720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:22.567973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 244/484] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:22.577351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:22.579378 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:22.580763 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-768841b4-7711-4347-84e9-1dfc6dfdfdfc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.205486 Jul 28 22:31:22.582289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 241/485] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:22 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:22.957326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:22.958593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:22.964821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.965277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.966085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.966546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.979237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:22.980317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:22.990968 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.992034 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:22.993163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:22.993854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.015252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:23.182898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.186889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.202106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e131d288-eb12-4f78-82da-d9a1c3b5dc88 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1259 microversion: 2.1 time: 0.226234 Jul 28 22:31:23.215105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e905f8f3-2da2-4c95-96b1-c47f8b3e4291 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.262531 Jul 28 22:31:23.216118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 242/486] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:22 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:23.216247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 245/487] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:22 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:23.278585 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-ccb2fa54-fb09-41a8-a1cd-c5d2f65d1888 req-356f7470-1755-4911-98b1-f92945330d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5606c87-43fb-42b9-b876-929d94fff6bb", "name": "network-vif-plugged", "status": "completed", "tag": "7264386b-d8eb-4240-9b23-13c3bbbc0ba3"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:23.288962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ccb2fa54-fb09-41a8-a1cd-c5d2f65d1888 req-356f7470-1755-4911-98b1-f92945330d33 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:23.289468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ccb2fa54-fb09-41a8-a1cd-c5d2f65d1888 req-356f7470-1755-4911-98b1-f92945330d33 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.303787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-ccb2fa54-fb09-41a8-a1cd-c5d2f65d1888 req-356f7470-1755-4911-98b1-f92945330d33 service nova] Creating event network-vif-plugged:7264386b-d8eb-4240-9b23-13c3bbbc0ba3 for instance c5606c87-43fb-42b9-b876-929d94fff6bb on hv-cinder-85093 Jul 28 22:31:23.309085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-ccb2fa54-fb09-41a8-a1cd-c5d2f65d1888 req-356f7470-1755-4911-98b1-f92945330d33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Jul 28 22:31:23.309711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 243/488] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:23.380326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:23.380966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:23.384350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:23.388882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:23.389336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.390126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:23.390561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.558022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.567907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d154f00c-f32f-444f-8420-03a0cee251d9 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.191498 Jul 28 22:31:23.579554 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 246/489] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:23 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:23.609207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:23.610331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:23.618328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:23.618786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.619588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:23.620318 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:23.766465 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.789022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.790560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:23.791884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-aeda182a-a010-4fe3-af4c-26100ab1aa1f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.190322 Jul 28 22:31:23.792629 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 244/490] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:23 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:24.223425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:24.224223 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:24.230553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.231008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.231765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.232201 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.236054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:24.236673 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:24.243892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.244340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.245100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.245607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.457148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:24.468362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-10c42920-073f-4c2c-8804-08a8a395d14d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.235871 Jul 28 22:31:24.472790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 245/491] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:24 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:24.527933 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:24.537229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b140a2da-1da5-49c9-bce5-bedaacdc054b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1443 microversion: 2.1 time: 0.318584 Jul 28 22:31:24.567331 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 247/492] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:24 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1443 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:24.569904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:24.570957 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:24.577501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.577978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.579029 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.579614 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.592232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:24.592848 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:24.601124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.601710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.602376 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.602815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.807973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:24.826078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:24.826575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-456db050-1d78-43f6-8c66-22a140f9bb1a tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1443 microversion: 2.1 time: 0.259203 Jul 28 22:31:24.827757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 246/493] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:24 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1443 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:24.837960 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:24.840165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-65148f59-a5ac-407c-8c11-d1f673f8e218 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.251720 Jul 28 22:31:24.840735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:24.841450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 248/494] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:24 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:31:24.856624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.857188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:24.858392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:24.858835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:25.027026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:25.036453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:25.039123 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:25.039303 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-667b2098-4190-4087-a993-4d6a315893c9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.210460 Jul 28 22:31:25.039793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 247/495] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:24 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:25.496094 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:25.496710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:25.504910 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:25.505811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:25.507038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:25.508420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:25.700861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:25.713381 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-23aef3b8-cd24-4ba8-90fc-dc080dbe460e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.222442 Jul 28 22:31:25.714221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 249/496] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:25 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:25.868701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:25.870364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:25.880689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:25.881394 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:25.882334 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:25.882779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:26.066122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:26.067383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:26.080717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:26.082019 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:26.087190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:26.088280 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:26.091229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:26.100222 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3e53b933-bd42-481e-873e-39baa18fa21e tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.236573 Jul 28 22:31:26.102738 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 248/497] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:25 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:26.276547 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:26.290044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:26.303457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:26.304778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-579ea520-59f9-4b55-98e9-88fcea381502 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.245142 Jul 28 22:31:26.309385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 250/498] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:26 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:26.736156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:26.737056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:26.746373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:26.747178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:26.749148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:26.749800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:26.893146 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:26.941313 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:26.964981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d0647989-83c8-4fcb-bb24-a08ea757c3e9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.233309 Jul 28 22:31:26.979388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 249/499] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:26 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:27.123546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:27.125015 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:27.133885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.134581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:27.136166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.136809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:27.198139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-241ea7a5-f573-4b63-8ec1-e38318a98d0e req-e6cf5bc3-075f-4247-96b7-c89e4235ff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:27.227921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=8 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:27.232136 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-241ea7a5-f573-4b63-8ec1-e38318a98d0e req-e6cf5bc3-075f-4247-96b7-c89e4235ff96 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.232835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-241ea7a5-f573-4b63-8ec1-e38318a98d0e req-e6cf5bc3-075f-4247-96b7-c89e4235ff96 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:27.258903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-241ea7a5-f573-4b63-8ec1-e38318a98d0e req-e6cf5bc3-075f-4247-96b7-c89e4235ff96 service nova] Creating event network-changed:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:31:27.264031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-241ea7a5-f573-4b63-8ec1-e38318a98d0e req-e6cf5bc3-075f-4247-96b7-c89e4235ff96 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070843 Jul 28 22:31:27.264787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 250/500] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:27.330011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:27.330908 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:27.355558 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.359272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:27.362743 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.363203 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:27.405326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:27.430048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-abc5f86d-9348-47fa-8e51-fc7226cfb452 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.310522 Jul 28 22:31:27.442085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 251/501] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:27 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:27.623679 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:27.642325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:27.644716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:27.645967 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cb630120-07f7-4286-9a1b-590e78739fa9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.321346 Jul 28 22:31:27.646832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 251/502] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:27 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:27.990963 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:27.991579 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:27.998660 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:27.999527 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.000392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:28.000832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.166551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:28.182021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1788198a-966c-4474-a2d2-3d4e23609cc5 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.196685 Jul 28 22:31:28.182882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 252/503] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:27 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:28.453976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:28.455798 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:28.467687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:28.469072 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.470497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:28.471242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.676251 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:28.678347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:28.679246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:28.689883 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3634cb63-441f-449d-aecb-8c465ced21a2 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.241387 Jul 28 22:31:28.690997 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 252/504] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:28 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:28.726921 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:28.727544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.728510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:28.730218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:28.879906 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:28.891426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:28.892813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:28.895019 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d161c136-b6e8-4764-a0d6-94f12318f058 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.225192 Jul 28 22:31:28.895669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 253/505] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:28 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:29.208998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:29.209653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:29.216329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.216890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:29.217789 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.218305 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:29.366702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:29.378342 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e8b79f74-63ab-4445-838e-3cab29a7bd08 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.173326 Jul 28 22:31:29.379218 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 253/506] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:29 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:29.712907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:29.713870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:29.722234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.723051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:29.724100 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.724773 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:29.900282 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:29.923399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:29.925689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:29.935549 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e672d138-47ea-4a83-aa90-53590a94b8f6 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.225844 Jul 28 22:31:29.938557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.939059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 254/507] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:29 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:29.939809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:29.941250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:29.942101 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:30.133426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:30.141345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:30.143539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:30.144420 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-29267444-9643-422a-81c4-d66b7ac82a37 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.225029 Jul 28 22:31:30.145301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 254/508] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:29 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:30.401339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:30.402521 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:30.411065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:30.411448 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:30.412215 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:30.412647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:30.558735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:30.569402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bc8d09c3-474b-4fc9-b2f5-841525ccdb47 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.172639 Jul 28 22:31:30.570568 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 255/509] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:30 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:30.957571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:30.958386 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:30.965117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:30.965594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:30.966370 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:30.966812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:31.154162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:31.162964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9c517ff0-0b96-4560-8cf1-0f786e5bf61d tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.210192 Jul 28 22:31:31.163547 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 255/510] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:30 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:31.168660 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:31.169365 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:31.176676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:31.177357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:31.178161 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:31.178594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:31.387212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:31.403734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:31.418902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:31.420113 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3631dd9a-a6e3-4fbe-89db-e9277e24945a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.255754 Jul 28 22:31:31.420844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 256/511] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:31 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:31.595201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:31.597577 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:31.605167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:31.605888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:31.606839 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:31.607597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:31.762648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:31.777212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-45355d70-d3e2-4d6a-8cb8-f688b4a7397f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.182263 Jul 28 22:31:31.778186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 256/512] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:31 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:32.184602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:32.186105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:32.195182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.195636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.196412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.197179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.395556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:32.406230 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-188675e3-6ee0-4306-ad36-17813c86ffd1 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.225461 Jul 28 22:31:32.406821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 257/513] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:32 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:32.446737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:32.448431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:32.455390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.455884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.456690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.457335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.644910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:32.654299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:32.655886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:32.657100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1b10cd9d-16fa-45af-a47d-2c3d8331d381 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.214196 Jul 28 22:31:32.658224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 257/514] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:32 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:32.799771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:32.800271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:32.808221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.808667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.810057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:32.811575 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:32.988262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:32.996495 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:33.012354 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-07f206c2-25d9-46c3-9e62-d00652953fe4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.216464 Jul 28 22:31:33.016038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 258/515] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:32 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:33.428350 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:33.428924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:33.435143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:33.435599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:33.436374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:33.436819 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:33.568884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:33.576323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5a49aafc-446f-4717-a25f-225d1fcee001 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.152491 Jul 28 22:31:33.576885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 258/516] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:33 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:33.681716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:33.682232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:33.689001 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:33.689446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:33.690925 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:33.691363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:33.817225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:33.825717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:33.827216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:33.828353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-aa56bd0d-67b4-4827-b1b2-dbd72d13b710 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.150628 Jul 28 22:31:33.828904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 259/517] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:33 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:34.044786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:34.045325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:34.051923 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.052373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.053125 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.053624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.184221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:34.192372 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3dd88d12-eb06-40a6-9780-95f5cf42d457 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.150870 Jul 28 22:31:34.192946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 259/518] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:34 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:34.599129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:34.604195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:34.611723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.612205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.612990 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.614161 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.759812 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:34.767263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6f5d7d84-15fc-4460-859e-7e885e9ae344 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.172667 Jul 28 22:31:34.767825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 260/519] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:34 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:34.851471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:34.852164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:34.858670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.859122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.859887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:34.860326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:34.882272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:34.992906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:35.001557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:35.003062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:35.005421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-45b05e3a-3338-4adb-933e-f9f539cd1090 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.157413 Jul 28 22:31:35.006263 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 260/520] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:34 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:35.212248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:35.212853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:35.218879 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:35.219325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:35.220078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:35.220515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:35.349912 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:35.357195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9175c66c-37bf-41b9-a558-ac665348c3dc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1366 microversion: 2.1 time: 0.148831 Jul 28 22:31:35.357779 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 261/521] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:35 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:35.788703 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:35.789373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:35.795736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:35.796186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:35.796976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:35.797407 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:35.924542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:35.932693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0c6d0b7c-e675-4404-af91-1076968a9373 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.148400 Jul 28 22:31:35.933255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 261/522] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:35 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:36.028416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:36.029028 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:36.036293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.036769 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.037556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.038001 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.172787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:36.182374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:36.183921 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:36.185075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-23198720-0554-4479-82dc-d62fba3d7943 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.160625 Jul 28 22:31:36.185664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 262/523] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:36 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:36.378627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:36.379307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:36.381382 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:36.387637 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.388129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.389050 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.389483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.517715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:36.525842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f575eb14-1b9f-4639-89d9-7591ad63ab9a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1556 microversion: 2.1 time: 0.151016 Jul 28 22:31:36.526414 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 262/524] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:36 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:36.546898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:36.547391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:36.553701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.554159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.554942 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.555384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.631218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-45869216-78d7-4ffa-868f-fb889b5abd81 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087873 Jul 28 22:31:36.631846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 263/525] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:31:36 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:36.954588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:36.955315 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:36.961938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.962385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:36.963147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:36.963582 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:37.209480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:37.210850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:37.217383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:37.217854 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:37.218623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:37.219051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:37.591098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:37.598993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ef4eb78e-5b29-4401-80e8-bfef74cbd419 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.649362 Jul 28 22:31:37.599568 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 263/526] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:36 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:37.628553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:37.637929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:37.639455 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:37.640622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-657f4002-0494-4127-ae77-4eee35dd0804 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.436272 Jul 28 22:31:37.641192 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 264/527] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:37 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:38.109871 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-e1eeeae4-c9bb-4b0b-a83d-37e617fa28af req-82a5cb6b-190d-4e96-9604-9bb99887d25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5606c87-43fb-42b9-b876-929d94fff6bb", "tag": "7264386b-d8eb-4240-9b23-13c3bbbc0ba3"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:38.120479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e1eeeae4-c9bb-4b0b-a83d-37e617fa28af req-82a5cb6b-190d-4e96-9604-9bb99887d25e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:38.120928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-e1eeeae4-c9bb-4b0b-a83d-37e617fa28af req-82a5cb6b-190d-4e96-9604-9bb99887d25e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:38.132638 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-e1eeeae4-c9bb-4b0b-a83d-37e617fa28af req-82a5cb6b-190d-4e96-9604-9bb99887d25e service nova] Creating event network-changed:7264386b-d8eb-4240-9b23-13c3bbbc0ba3 for instance c5606c87-43fb-42b9-b876-929d94fff6bb on hv-cinder-85093 Jul 28 22:31:38.137876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-e1eeeae4-c9bb-4b0b-a83d-37e617fa28af req-82a5cb6b-190d-4e96-9604-9bb99887d25e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 Jul 28 22:31:38.138674 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 264/528] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:38.619541 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:38.620258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:38.626975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:38.627216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:38.627924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:38.628360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:38.664674 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:38.665786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:38.674502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:38.675309 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:38.676834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:38.677615 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:38.838195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:38.846320 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6a42a018-7a05-4ef2-9a99-ca7e47b852b3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.230589 Jul 28 22:31:38.847085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 265/529] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:38 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:38.869188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:38.879196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:38.881552 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:38.882739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f0f6cf44-a262-4633-97e8-f3a10c54e447 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.222238 Jul 28 22:31:38.883302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 265/530] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:38 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:39.868194 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:39.868801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:39.876498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:39.876942 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:39.877723 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:39.878151 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:39.905962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:39.906568 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:39.914183 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:39.914632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:39.915421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:39.915855 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:40.059414 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:40.066950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-751f98d1-aa8d-4020-8111-9fdead9489e7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.202553 Jul 28 22:31:40.067521 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 266/531] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:39 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:40.085646 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:40.094188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:40.095702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:40.096860 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-514feb43-f5cd-4934-9c59-b3f31e961d35 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.194728 Jul 28 22:31:40.098044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 266/532] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:39 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:40.858442 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-92f8b0f5-2417-4dfd-864c-e5c5c7a7fecf req-ed2a01da-8e11-4324-ba13-09ce869afcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9801b94a-6893-4344-8e6e-515696709595", "name": "network-vif-plugged", "status": "completed", "tag": "4c1a96a3-47cd-47cc-b876-541c3e717ee5"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:40.868620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-92f8b0f5-2417-4dfd-864c-e5c5c7a7fecf req-ed2a01da-8e11-4324-ba13-09ce869afcec service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:40.869232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-92f8b0f5-2417-4dfd-864c-e5c5c7a7fecf req-ed2a01da-8e11-4324-ba13-09ce869afcec service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:40.882184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-92f8b0f5-2417-4dfd-864c-e5c5c7a7fecf req-ed2a01da-8e11-4324-ba13-09ce869afcec service nova] Creating event network-vif-plugged:4c1a96a3-47cd-47cc-b876-541c3e717ee5 for instance 9801b94a-6893-4344-8e6e-515696709595 on hv-cinder-85093 Jul 28 22:31:40.887078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-92f8b0f5-2417-4dfd-864c-e5c5c7a7fecf req-ed2a01da-8e11-4324-ba13-09ce869afcec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Jul 28 22:31:40.887830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 267/533] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:41.087916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:41.088444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:41.095092 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:41.095552 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:41.096320 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:41.097057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:41.121111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:41.122098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:41.128472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:41.129460 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:41.130255 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:41.131129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:41.289726 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:41.297186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a41ba1f3-f368-421d-9cf3-e43c7545ad9a tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.213531 Jul 28 22:31:41.297786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 267/534] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:41 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:41.316670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:41.325241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:41.326799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:41.327968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-62c2e76c-807b-4cb5-b3e2-b12598aa89e5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.211331 Jul 28 22:31:41.328529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 268/535] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:41 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:42.319418 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:42.320032 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:42.326624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:42.327077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:42.327841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:42.328276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:42.351509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:42.352111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:42.358709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:42.359161 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:42.359927 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:42.360361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:42.506282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:42.513816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ae80acd1-5312-41aa-a5a4-9338f12257af tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.198879 Jul 28 22:31:42.514393 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 268/536] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:42 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:42.529064 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:42.537736 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:42.539232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:42.540408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-27e79ab9-e725-4499-93f4-dfea86903619 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.193372 Jul 28 22:31:42.540975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 269/537] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:42 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:43.534443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:43.535044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:43.541255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:43.541751 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:43.542517 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:43.542954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:43.562641 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:43.563241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:43.570358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:43.570806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:43.571576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:43.572008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:43.756120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:43.763618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1ccf1a71-6d0a-4724-8e2f-9bc60e892586 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1318 microversion: 2.1 time: 0.233026 Jul 28 22:31:43.764197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 269/538] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:43 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:43.767637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:43.776774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:43.778373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:43.779552 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-33c6d6d6-c19e-48f2-a36b-fe1d38aabbfa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.220739 Jul 28 22:31:43.780111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 270/539] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:43 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:44.784229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:44.785287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:44.791336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:44.791786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:44.792545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:44.792979 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:44.803681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:44.804476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:44.811231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:44.811695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:44.812471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:44.812913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:44.988275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:44.995778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-23f1f1cf-8803-49d8-9bcf-3a7b77c74845 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1507 microversion: 2.1 time: 0.215361 Jul 28 22:31:44.996346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 270/540] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:31:44 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:31:45.017345 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:45.018423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d45af849-33a3-463e-8cca-e83af0755263", "device": "/dev/sdb"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:45.022352 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:45.027498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:45.028524 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:45.028984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:45.029098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:45.029794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:45.030172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cad083c5-3754-46bf-b6a4-baeae4aff1be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.231116 Jul 28 22:31:45.030291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:45.030740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 271/541] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:44 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:31:45.277886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9781c21e-0386-4124-9b98-382aa81bc875 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "POST /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263952 Jul 28 22:31:45.278799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 271/542] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:31:45 2022] POST /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:31:46.054317 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:46.054869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:46.061363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:46.061853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:46.062608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:46.063039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:46.196978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:46.205363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:46.207033 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:46.208171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-20c40c7a-3f5f-4917-ac49-354979b35e0f tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.158826 Jul 28 22:31:46.208725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 272/543] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:46 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:46.865570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-4b79e1a3-9957-4bc8-83a1-88e32280afda req-41df7ed2-df8c-4af2-8579-48589a87212f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "name": "network-vif-plugged", "status": "completed", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:31:46.876204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-4b79e1a3-9957-4bc8-83a1-88e32280afda req-41df7ed2-df8c-4af2-8579-48589a87212f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:46.876664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-4b79e1a3-9957-4bc8-83a1-88e32280afda req-41df7ed2-df8c-4af2-8579-48589a87212f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:46.888324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-4b79e1a3-9957-4bc8-83a1-88e32280afda req-41df7ed2-df8c-4af2-8579-48589a87212f service nova] Creating event network-vif-plugged:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:31:46.893003 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-4b79e1a3-9957-4bc8-83a1-88e32280afda req-41df7ed2-df8c-4af2-8579-48589a87212f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Jul 28 22:31:46.894389 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 272/544] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:31:47.231122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:47.231727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:47.238623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:47.239072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:47.239838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:47.240267 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:47.369548 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:47.379130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:47.380372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:47.382021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e7c21398-af58-4823-98e0-cdc1c7d2e85d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.154746 Jul 28 22:31:47.382640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 273/545] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:47 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:48.406768 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:48.407392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:48.414351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:48.414804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:48.415569 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:48.416009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:48.547061 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:48.555917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:48.557468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:48.558685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-20c045c1-9e54-443f-8047-c1591f45450a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.156914 Jul 28 22:31:48.559246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 273/546] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:48 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:49.582131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:49.582754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:49.589224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:49.589716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:49.590473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:49.590907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:49.726623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:49.735037 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:49.736549 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:49.738853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cf6402fb-53a0-4fee-86d5-0b386a3a249a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.160088 Jul 28 22:31:49.739434 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 274/547] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:49 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:50.762323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:50.762858 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:50.769981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:50.770431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:50.771188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:50.771621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:50.900525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:50.908994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:50.911028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:50.912188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bcc98770-247b-4a52-972a-abf2180933cb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.153850 Jul 28 22:31:50.912746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 274/548] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:50 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:51.935676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:51.936289 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:51.943917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:51.944361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:51.946581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:51.947399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:52.083945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:52.092893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:52.094430 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:52.095577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5226d12f-680a-408c-bab3-a8cc17adba6d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1807 microversion: 2.20 time: 0.163959 Jul 28 22:31:52.096136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 275/549] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:51 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:31:53.119645 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:31:53.120297 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:31:53.126978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:53.127425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:53.128181 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:31:53.128616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:31:53.262734 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:53.271325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:53.272822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:31:53.274036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f1dc0068-7d34-4517-bea5-fd8f1a99036a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1794 microversion: 2.20 time: 0.158499 Jul 28 22:31:53.274596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 275/550] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:31:53 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:05.699332 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:05.699839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:05.702089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=58 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:05.702731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=96 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:05.708783 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:05.709222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:05.710036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:05.710466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:05.788681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lazy-loading 'services' on Instance uuid 9801b94a-6893-4344-8e6e-515696709595 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:05.861797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c99eef3c-1d63-4e40-83e2-2a6ce4d3bbb7 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595/os-volume_attachments/d45af849-33a3-463e-8cca-e83af0755263" status: 202 len: 0 microversion: 2.1 time: 0.166324 Jul 28 22:32:05.862403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 276/551] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:32:05 2022] DELETE /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595/os-volume_attachments/d45af849-33a3-463e-8cca-e83af0755263 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:06.984424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:06.984954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:06.987556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=27 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:06.988208 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:06.995005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:06.995455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:06.996201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:06.996785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:07.023941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:32:07.096094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6b5762c4-5021-4f14-ac27-df9b3d7a5661 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 204 len: 0 microversion: 2.1 time: 0.115151 Jul 28 22:32:07.096940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 276/552] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:32:06 2022] DELETE /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:32:07.106562 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:07.107254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:07.113368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:07.113874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:07.114692 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:07.115120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:07.248744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:07.256701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d73ba15a-d063-4e9c-9c51-a1a510ed32c3 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1513 microversion: 2.1 time: 0.154807 Jul 28 22:32:07.257261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 277/553] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:07 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:08.278226 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:08.278941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:08.285488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:08.286531 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:08.287302 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:08.287743 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:08.417619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:08.425161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e05577d6-4a5b-4164-bba4-8b836e9c75ef tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1513 microversion: 2.1 time: 0.151165 Jul 28 22:32:08.425757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 277/554] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:08 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:09.446985 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:09.447594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:09.454229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:09.454680 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:09.455440 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:09.455873 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:09.585952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:09.593481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-43f30364-41f0-4565-ad1b-ddc514ec4ea4 tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1513 microversion: 2.1 time: 0.150360 Jul 28 22:32:09.594073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 278/555] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:09 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:10.267481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-91be4b73-a360-4902-89fd-2f54fdfcd102 req-0675a0e6-c2c8-4dd6-a0e5-3bd0c4e71263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9801b94a-6893-4344-8e6e-515696709595", "name": "network-vif-deleted", "tag": "4c1a96a3-47cd-47cc-b876-541c3e717ee5"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:10.279107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-91be4b73-a360-4902-89fd-2f54fdfcd102 req-0675a0e6-c2c8-4dd6-a0e5-3bd0c4e71263 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:10.279541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-91be4b73-a360-4902-89fd-2f54fdfcd102 req-0675a0e6-c2c8-4dd6-a0e5-3bd0c4e71263 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:10.291206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-91be4b73-a360-4902-89fd-2f54fdfcd102 req-0675a0e6-c2c8-4dd6-a0e5-3bd0c4e71263 service nova] Creating event network-vif-deleted:4c1a96a3-47cd-47cc-b876-541c3e717ee5 for instance 9801b94a-6893-4344-8e6e-515696709595 on hv-cinder-85093 Jul 28 22:32:10.295938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-91be4b73-a360-4902-89fd-2f54fdfcd102 req-0675a0e6-c2c8-4dd6-a0e5-3bd0c4e71263 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Jul 28 22:32:10.296732 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 278/556] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:10.614956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:10.615569 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:10.622057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:10.622514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:10.623278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:10.623722 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:10.655118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:10.655596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:10.656061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lazy-loading 'fault' on Instance uuid 9801b94a-6893-4344-8e6e-515696709595 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:10.702187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5b147068c2491c9e4c95bbf5d0cbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5c439035bf4fe1bcf123752ab0566f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:10.710644 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-69b6c18d-37bd-40a4-a799-e6b85ff14eeb tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 200 len: 1308 microversion: 2.1 time: 0.099654 Jul 28 22:32:10.711233 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 279/557] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:10 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:11.732470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:11.733233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] [instance: 9801b94a-6893-4344-8e6e-515696709595] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:11.739869 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:11.740324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:11.741092 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:11.741548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:11.754482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] HTTP exception thrown: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Request method failure captured: Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 HTTP/1.1 Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w238bvu95X4wyzPueBWV8AR3WYcM4gWLf17_mAKC-8Mhnu2z4ZEKyQVFCwV22wQfDKU3CzZ2k1XtO2n_K0tuhtcSNRwusxlLVgsaBIXHC4appO29cCGVPeK_RkJuPDl2ihCh8OYNCFns_BYLedpOZmYNmaNPPbTEccbNGjp7nhxPTc Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: da5c439035bf4fe1bcf123752ab0566f Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:32:11.756329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_da5c439035bf4fe1bcf123752ab0566f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: da5c439035bf4fe1bcf123752ab0566f Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1350472687 Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesSnapshotTestJSON-1350472687-project Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 9d5b147068c2491c9e4c95bbf5d0cbdd Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesSnapshotTestJSON-1350472687-project Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. Jul 28 22:32:11.757976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '9801b94a-6893-4344-8e6e-515696709595'} Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:11.758889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. Jul 28 22:32:11.760120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:11.761180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] Returning 404 to user: Instance 9801b94a-6893-4344-8e6e-515696709595 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:11.761180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ea7a1b06-e26c-4e38-8e56-36d07afce5ac tempest-VolumesSnapshotTestJSON-1350472687 tempest-VolumesSnapshotTestJSON-1350472687-project] 10.222.0.39 "GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jul 28 22:32:11.761180 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 279/558] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:11 2022] GET /compute/v2.1/servers/9801b94a-6893-4344-8e6e-515696709595 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:32:21.761059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:21.761652 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:21.764197 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=10 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:21.764845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:21.770986 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:21.771439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:21.772203 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:21.772643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:21.852424 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lazy-loading 'services' on Instance uuid 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:21.922174 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0a0555f6-dac5-4a98-a142-ccf14d7ae3c7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments/f49914da-e5fd-4d86-a39c-87e96bbe2c08" status: 202 len: 0 microversion: 2.1 time: 0.165000 Jul 28 22:32:21.922938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 280/559] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:32:21 2022] DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments/f49914da-e5fd-4d86-a39c-87e96bbe2c08 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:23.052905 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e4ada87-179c-44d7-8fb6-be4b33d22a98"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:23.055306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:23.057879 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:23.058522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:23.064475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:23.064923 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:23.065717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:23.066153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:24.596536 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-510a1b89-cb32-4dbf-915c-2706f76fb8cc tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.547936 Jul 28 22:32:24.597214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 280/560] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:32:23 2022] POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments => generated 194 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:26.213173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e2d9c9e6-a9b9-47dc-ae23-65ecf3417287 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:26.219883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2d9c9e6-a9b9-47dc-ae23-65ecf3417287 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:26.220328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2d9c9e6-a9b9-47dc-ae23-65ecf3417287 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:26.280781 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e2d9c9e6-a9b9-47dc-ae23-65ecf3417287 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Going to try to stop instance {{(pid=118085) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 28 22:32:26.323204 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e2d9c9e6-a9b9-47dc-ae23-65ecf3417287 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action" status: 202 len: 0 microversion: 2.1 time: 0.114120 Jul 28 22:32:26.323799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 281/561] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:32:26 2022] POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:26.333812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:26.334550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:26.341174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:26.341649 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:26.342430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:26.342954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:26.475093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:26.482618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8c55bdf0-33a6-4f98-be3c-b00722fb5ce7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.154292 Jul 28 22:32:26.483185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 281/562] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:26 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:27.505797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:27.506491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:27.512858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:27.513303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:27.514087 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:27.514515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:27.647403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:27.654839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f8119739-f29c-4478-abfb-e1d4ba4f679b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.154870 Jul 28 22:32:27.655412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 282/563] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:27 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:28.677430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:28.678081 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:28.684588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:28.685040 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:28.685831 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:28.686269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:28.817908 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:28.825516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1465e9d6-aad6-4880-957f-ff2d806653c4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.152496 Jul 28 22:32:28.826146 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 282/564] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:28 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:29.847198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:29.847801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:29.854807 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:29.855256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:29.856014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:29.856450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:29.994844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:30.002432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-80f7311e-7cb8-4e45-9f61-ec098a40f784 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.159037 Jul 28 22:32:30.002988 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 283/565] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:29 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:31.024590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:31.025201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:31.031575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:31.032026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:31.032784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:31.033218 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:31.164808 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:31.172329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a27495f8-f940-41b9-8c57-c110ecaa608f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.152138 Jul 28 22:32:31.172885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 283/566] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:31 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:32.181739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:32.184017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:32.190172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.190634 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.191394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.191825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.193775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:32.194510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:32.200904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.201351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.202138 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.202573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.214415 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lazy-loading 'flavor' on Instance uuid b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:32.350368 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:32.352435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-81e585be-feb4-4fc0-9a17-3e7369164067 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/action" status: 200 len: 32 microversion: 2.1 time: 0.175740 Jul 28 22:32:32.352956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 284/567] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:32:32 2022] POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:32:32.358661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1d6c7157-69f8-4b08-b6b0-813b3cdbfc7b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.168701 Jul 28 22:32:32.359424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 284/568] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:32 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:32.363408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:32.364717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:32.371120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.371633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.372419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:32.372858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:32.503901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:32.512221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-152e201b-7f6b-44fb-ad89-5ee109be9e56 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.152876 Jul 28 22:32:32.512795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 285/569] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:32 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:33.382659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:33.383201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:33.389834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:33.390300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:33.391063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:33.391506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:33.522534 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:33.530354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-037aa36a-0845-442e-b461-9b5ec1cfc315 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.152541 Jul 28 22:32:33.531106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 285/570] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:33 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:33.534257 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:33.534860 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:33.542003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:33.542446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:33.543203 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:33.543631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:33.669388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:33.677408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-67078eb6-a2f3-47ac-91b0-b233f4ebc2e2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.146981 Jul 28 22:32:33.677980 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 286/571] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:33 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:34.552217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:34.552846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:34.560116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:34.560532 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:34.561425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:34.561943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:34.694267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:34.699027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:34.699671 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:34.701921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-555168eb-1a7f-4b6e-8215-45e8b02dc8e0 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.153625 Jul 28 22:32:34.702483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 286/572] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:34 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:34.709874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:34.710346 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:34.711124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:34.711557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:34.840958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:34.849014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-44cd59f3-09dd-4717-b60c-1fd0b7da309a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.153836 Jul 28 22:32:34.849592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 287/573] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:34 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:35.724595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:35.725300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:35.732295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:35.732746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:35.733515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:35.733994 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:35.871177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:35.871809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:35.879618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:35.880718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:35.881980 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:35.882620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:35.890563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:35.899029 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-636bacbf-f1e9-412e-bbb0-4f114ac6bf57 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1678 microversion: 2.1 time: 0.178675 Jul 28 22:32:35.899815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 287/574] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:35 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:36.024157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:36.032007 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9f0ce27c-9bb3-4218-bd76-a6abaf1b6365 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.164735 Jul 28 22:32:36.032578 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 288/575] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:35 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:36.338319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:36.338812 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:36.344824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.345275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.346072 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.346506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.370631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-aed5f4a9-a442-422e-aec3-0a36ae9b6dce tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/ips" status: 200 len: 149 microversion: 2.1 time: 0.036158 Jul 28 22:32:36.371228 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 288/576] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:32:36 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:36.384598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf577e7-e038-4d43-8af7-5609091fb5b3"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:36.387743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:36.394569 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.394960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.395722 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.396194 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.477502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: POST /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/os-volume_attachments HTTP/1.1 Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 74 Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:32:36.479225 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {"volumeAttachment": {"volumeId": "acf577e7-e038-4d43-8af7-5609091fb5b3"}} Jul 28 22:32:36.480825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'server_id': 'c5606c87-43fb-42b9-b876-929d94fff6bb', 'body': {'volumeAttachment': {'volumeId': 'acf577e7-e038-4d43-8af7-5609091fb5b3'}}} Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:36.482054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:36.483479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 400 to user: Invalid volume: volume acf577e7-e038-4d43-8af7-5609091fb5b3 is already attached to instances: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-185df107-eb01-4d85-9636-d51a4d882f32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101159 Jul 28 22:32:36.485832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 289/577] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:32:36 2022] POST /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 22:32:36.489501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:36.490703 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:36.496515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.496969 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.497959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.498395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.526188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:32:36.623270 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ca779ae7-05e0-47e9-abe1-5cb77d377a85 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 204 len: 0 microversion: 2.1 time: 0.137210 Jul 28 22:32:36.624151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 289/578] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:32:36 2022] DELETE /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:32:36.634351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:36.635073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:36.642655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.643200 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.644063 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.644645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.779185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:36.787062 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f1fbed15-108b-421a-ad0c-008d5824dd36 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1680 microversion: 2.1 time: 0.157954 Jul 28 22:32:36.789553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 290/579] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:36 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:36.922813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:36.923518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:36.930559 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.931012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:36.931782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:36.932215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.054732 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:37.055346 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:37.061794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.062245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.063017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.063447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.396313 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:37.404123 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-11c5e790-9625-4dda-aeec-b72385eaf316 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1655 microversion: 2.1 time: 0.485499 Jul 28 22:32:37.404685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 290/580] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:36 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1655 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:37.426915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6aac4e18-10d6-4385-9dcb-cb9ebc175b04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:37.435063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6aac4e18-10d6-4385-9dcb-cb9ebc175b04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.435666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6aac4e18-10d6-4385-9dcb-cb9ebc175b04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.457843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6aac4e18-10d6-4385-9dcb-cb9ebc175b04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Going to try to start instance {{(pid=118086) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 28 22:32:37.501974 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6aac4e18-10d6-4385-9dcb-cb9ebc175b04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action" status: 202 len: 0 microversion: 2.1 time: 0.079775 Jul 28 22:32:37.502753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 291/581] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:32:37 2022] POST /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 22:32:37.512211 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:37.513017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:37.519430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.519893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.520642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.521910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.529045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:37.537906 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-76feff57-3171-4f53-b2ce-7f7ddc1256d9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.487866 Jul 28 22:32:37.538480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 291/582] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:37 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:37.684284 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:37.688207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:37.694431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ceb13728-4692-44d4-bffb-5a99254c56fd tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1664 microversion: 2.1 time: 0.186245 Jul 28 22:32:37.695102 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 292/583] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:37 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:37.809327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:37.810229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:37.816205 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.816656 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.817417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:37.817923 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:37.964546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:37.968318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:37.972838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-fddfe514-7eaa-4578-bfeb-5ac42d1f3b3f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1680 microversion: 2.1 time: 0.167779 Jul 28 22:32:37.973419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 292/584] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:37 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:38.561129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:38.562608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:38.576091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:38.576782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:38.577810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:38.578493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:38.721817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:38.724858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:38.732826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:38.733399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:38.734548 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:38.735135 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:38.736412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:38.756892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-70316784-09f2-4198-9a23-9bf78deef34b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.201704 Jul 28 22:32:38.757481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 293/585] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:38 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:38.920647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:38.934688 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-809f953c-abcb-465b-8fa7-9b7da5836572 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1664 microversion: 2.1 time: 0.222218 Jul 28 22:32:38.935924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 293/586] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:38 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1664 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:38.996742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:38.997355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:39.003352 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.003801 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:39.004558 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.005246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:39.136251 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:39.145093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5261bd30-a9bc-42e5-b4a4-6a2a1c2a31c0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1680 microversion: 2.1 time: 0.152167 Jul 28 22:32:39.152680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 294/587] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:38 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:39.781594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:39.782212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:39.794653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.795344 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:39.797098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.797933 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:39.956451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:39.957406 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:39.964520 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.966136 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:39.967165 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:39.967975 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:40.027295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:40.038096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-992dec71-1e86-4e8b-ab0a-0c36d0acb10f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.258920 Jul 28 22:32:40.038727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 294/588] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:39 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:40.169071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:40.169730 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:40.172435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:40.178456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:40.179305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:40.180296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:40.180734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:40.187518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-68203e4d-9318-41c1-9738-25cc781eccd8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1664 microversion: 2.1 time: 0.232052 Jul 28 22:32:40.188946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 295/589] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:39 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1664 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:40.272704 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:40.281310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4e0d0843-1574-4824-9db3-c15b44efbfe6 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1612 microversion: 2.1 time: 0.116127 Jul 28 22:32:40.289442 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 295/590] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:40 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1612 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:40.841308 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-80921443-b245-41aa-9e25-c6e491efcf3b req-0ee20c46-d51b-46f5-9356-41d47ff89a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5606c87-43fb-42b9-b876-929d94fff6bb", "name": "network-vif-deleted", "tag": "7264386b-d8eb-4240-9b23-13c3bbbc0ba3"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:40.857472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-80921443-b245-41aa-9e25-c6e491efcf3b req-0ee20c46-d51b-46f5-9356-41d47ff89a08 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:40.869482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-80921443-b245-41aa-9e25-c6e491efcf3b req-0ee20c46-d51b-46f5-9356-41d47ff89a08 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:40.886110 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-80921443-b245-41aa-9e25-c6e491efcf3b req-0ee20c46-d51b-46f5-9356-41d47ff89a08 service nova] Creating event network-vif-deleted:7264386b-d8eb-4240-9b23-13c3bbbc0ba3 for instance c5606c87-43fb-42b9-b876-929d94fff6bb on hv-cinder-85093 Jul 28 22:32:40.898350 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-80921443-b245-41aa-9e25-c6e491efcf3b req-0ee20c46-d51b-46f5-9356-41d47ff89a08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057892 Jul 28 22:32:40.900145 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 296/591] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:41.064262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:41.065464 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:41.072746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.073506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.074311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.074744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.214412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:41.215656 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:41.227940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.229817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:41.230414 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.231499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.232327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.240730 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5a387317-5e17-413d-a611-b2d45d713e8d tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.180312 Jul 28 22:32:41.257293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 296/592] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:41 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:41.305691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:41.306664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:41.317502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.318851 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.320364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.323008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.408176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:41.408877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:41.411622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'fault' on Instance uuid c5606c87-43fb-42b9-b876-929d94fff6bb {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:41.495341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:41.503371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c36d8e2e-6256-4e6e-9d4f-5fbef705c5df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 200 len: 1330 microversion: 2.1 time: 0.201773 Jul 28 22:32:41.509852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 297/593] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:41 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:41.517510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:41.530367 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3cd44e87-0574-454e-8ae5-8d7fc92a5b97 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1668 microversion: 2.1 time: 0.320247 Jul 28 22:32:41.531177 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 297/594] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:41 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1668 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:42.156883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.158009 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:42.169667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.178029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.179192 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.183754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.245966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7d46a9c8-c9ac-49cd-9cfc-185316e727ea tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments/abfdd6b9-bc1b-4bd9-8a17-7f164b420815" status: 200 len: 194 microversion: 2.20 time: 0.093060 Jul 28 22:32:42.246964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 298/595] 10.222.0.39 () {60 vars in 1454 bytes} [Thu Jul 28 22:32:42 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments/abfdd6b9-bc1b-4bd9-8a17-7f164b420815 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:32:42.264933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.265756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:42.278062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.278752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.279690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.280630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.322060 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.322657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:42.329299 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.330236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.330973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.331430 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.474710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lazy-loading 'services' on Instance uuid 782b475d-87bc-47f5-9cc2-4245086dc6c4 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:42.526032 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:42.537243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2b1c6fc8-68eb-4022-a5c4-7d876c92f22a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.276195 Jul 28 22:32:42.538405 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 298/596] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:42 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:42.543639 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.544427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:42.551077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.551551 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.552357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.552782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.581105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:32:42.582966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cb3769d3-f35f-4c76-bd0b-4025799569f3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments/abfdd6b9-bc1b-4bd9-8a17-7f164b420815" status: 202 len: 0 microversion: 2.20 time: 0.266484 Jul 28 22:32:42.583915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 299/597] 10.222.0.39 () {60 vars in 1457 bytes} [Thu Jul 28 22:32:42 2022] DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments/abfdd6b9-bc1b-4bd9-8a17-7f164b420815 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb HTTP/1.1 Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:32:42.586028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:32:42.587289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': 'c5606c87-43fb-42b9-b876-929d94fff6bb'} Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:42.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:32:42.589152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:42.592909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:42.593021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.594710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d9275a03-f081-48ee-b1f0-18f50c61d203 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 404 len: 111 microversion: 2.1 time: 0.055177 Jul 28 22:32:42.595505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 299/598] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:42 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:32:42.601219 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:42.622229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9bac8b3e-8086-4198-8271-c9d432d7533f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '.version_select at 0x7f743c2064c0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:42.622645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.623106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.623900 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:42.624505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:42.697069 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9bac8b3e-8086-4198-8271-c9d432d7533f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196127535" status: 202 len: 0 microversion: 2.1 time: 0.094562 Jul 28 22:32:42.698224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 300/599] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Jul 28 22:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196127535 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:42.699624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e720b8d8-5f0d-4177-b53a-06474951a309 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107405 Jul 28 22:32:42.700760 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 300/600] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Jul 28 22:32:42 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:32:43.563361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:43.564649 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:43.582541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.583012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.590478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.591246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.705979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:43.707182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:43.714803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.716121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.717041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.718215 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.800818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:43.810439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ea041e40-4fb6-44e8-9774-82f1eed89078 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.251200 Jul 28 22:32:43.811775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 301/601] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:43 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:32:43.816761 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:43.819893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:43.826678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.827354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.828931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.829244 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.869182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1a949b2c-c62e-47c6-8aa9-3ed31c7a2739 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056061 Jul 28 22:32:43.870844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 302/602] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Jul 28 22:32:43 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:43.895096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'services' on Instance uuid 41e2af9e-d8ce-4edd-8aae-4158d00ef92f {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:43.980554 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:43.981726 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:43.988458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.988907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:43.990499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:43.991122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.026007 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c32913dc-38d9-4805-9b8a-84207f6d72c4 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments/acf577e7-e038-4d43-8af7-5609091fb5b3" status: 202 len: 0 microversion: 2.1 time: 0.323580 Jul 28 22:32:44.026959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 301/603] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:32:43 2022] DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments/acf577e7-e038-4d43-8af7-5609091fb5b3 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:44.043124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:44.052165 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:32:44.055193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:44.065874 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.066338 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.073066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.073515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.124318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-606377cb-e546-42ed-ab37-c9a4550c79cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088300 Jul 28 22:32:44.126484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 302/604] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:32:44 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:44.196009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cf377b80-b368-40fc-a3e7-b363c5450367 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 204 len: 0 microversion: 2.20 time: 0.219071 Jul 28 22:32:44.196895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 303/605] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Jul 28 22:32:43 2022] DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 22:32:44.205147 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:44.205973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:44.213148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.213719 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.214602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.215108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.365135 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:44.373251 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:44.374787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:44.375971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1bbf548e-6a8b-4a6d-93a0-ab3b602237f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.174678 Jul 28 22:32:44.376516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 303/606] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:44 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:44.833044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:44.835087 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:44.841944 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.842516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:44.843358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:44.844036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:45.003774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:45.013785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bfab31ee-9163-48fa-a3cc-b6b8cbb0c887 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.184813 Jul 28 22:32:45.014371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 304/607] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:44 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:45.139545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:45.143357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:45.157008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:45.157708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:45.158710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:45.159349 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:45.194424 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3a3b4bef-2676-4c56-9068-e4f0206c65fc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058406 Jul 28 22:32:45.201146 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 304/608] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:32:45 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:45.401299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:45.401571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:45.408575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:45.409289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:45.410333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:45.411020 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:45.576292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:45.587080 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:45.588924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:45.590357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8ca4055c-ed27-46bb-89c6-9256584529a7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.193900 Jul 28 22:32:45.591136 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 305/609] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:45 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:32:46.036423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:46.039012 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:46.048146 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.049092 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.050293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.051123 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.208818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:46.220107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:46.232478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.233200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.237363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.238707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.313404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-98f9b9f8-a605-4f81-9796-ab3c34d8707e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109133 Jul 28 22:32:46.321954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 306/610] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:32:46 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:46.380457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:46.399428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b1d000b8-fcdf-46ee-8292-3ec8732c4ea1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.365518 Jul 28 22:32:46.413956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 305/611] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:46 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:46.616316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:46.616939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:46.627832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.628292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.629091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:46.629580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:46.857152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:46.865453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:46.867001 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:46.868179 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-34e05d7b-8914-4760-a864-e1a122667755 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1722 microversion: 2.20 time: 0.256473 Jul 28 22:32:46.868745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 307/612] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:46 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:47.330428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:47.335558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:47.342713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.343305 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.344362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.344902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.380609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a6dffeca-60c2-455b-a0e0-dd9679c33953 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057209 Jul 28 22:32:47.382356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 306/613] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:32:47 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:32:47.420870 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:47.421811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:47.432351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.434136 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.436426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.437487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.494298 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:47.494834 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:47.513329 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.513793 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.514796 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.515093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.576658 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:32:47.579809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:47.681391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:47.704941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b1ca05e7-4074-4cd2-bdf1-66c5638e88ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.287182 Jul 28 22:32:47.713279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 308/614] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:47 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:47.749775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9d0f7750-0feb-4dd9-8b68-aa94ebe7feb0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 204 len: 0 microversion: 2.1 time: 0.260135 Jul 28 22:32:47.750427 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 307/615] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:32:47 2022] DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 22:32:47.759721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:47.760584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:47.767137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.767956 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.769056 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.769735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.897786 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:47.898744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:47.925759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.931634 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.937926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:47.938985 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:47.944909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:47.960194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-99216078-6ee3-4fe1-8ffa-305f6f87e50d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1681 microversion: 2.1 time: 0.204476 Jul 28 22:32:47.962772 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 309/616] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:47 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:48.056791 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:48.077731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:48.079249 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:48.080635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-72096e69-d311-49f9-81e9-6cb5087a6452 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1655 microversion: 2.20 time: 0.188564 Jul 28 22:32:48.092029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 308/617] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:47 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1655 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:32:48.479565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-11607591-1118-4564-81ea-2ab7e845a15b req-8be9a3bd-378d-49d2-b19c-9f1c07bdb560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b475d-87bc-47f5-9cc2-4245086dc6c4", "name": "network-vif-deleted", "tag": "69cbbc60-3ab6-406c-b5fc-7e37b29888d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:48.506497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-11607591-1118-4564-81ea-2ab7e845a15b req-8be9a3bd-378d-49d2-b19c-9f1c07bdb560 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:48.507332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-11607591-1118-4564-81ea-2ab7e845a15b req-8be9a3bd-378d-49d2-b19c-9f1c07bdb560 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:48.514524 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:48.526187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-11607591-1118-4564-81ea-2ab7e845a15b req-8be9a3bd-378d-49d2-b19c-9f1c07bdb560 service nova] Creating event network-vif-deleted:69cbbc60-3ab6-406c-b5fc-7e37b29888d2 for instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 on hv-cinder-85093 Jul 28 22:32:48.533326 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-11607591-1118-4564-81ea-2ab7e845a15b req-8be9a3bd-378d-49d2-b19c-9f1c07bdb560 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059164 Jul 28 22:32:48.534710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 310/618] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:48.737962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:48.738568 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:48.750537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:48.751000 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:48.751767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:48.752198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:48.904982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:48.914423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1bec7abd-3574-42f9-9218-b2bef41fe45c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.180616 Jul 28 22:32:48.915292 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 309/619] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:48 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:48.984753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:48.985900 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:48.996258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:48.997262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:48.998362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:48.999014 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:49.108148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:49.108922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:49.118088 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:49.118539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:49.119348 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:49.119783 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:49.264186 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:49.274857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:49.283876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-214f1297-ba63-4088-9ad5-d994991bdcc2 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1681 microversion: 2.1 time: 0.304293 Jul 28 22:32:49.284666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 311/620] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:48 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:49.289855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:49.296910 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:49.300725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-aeb6584f-6b84-4228-9c30-27e7d6fcc342 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1655 microversion: 2.20 time: 0.195032 Jul 28 22:32:49.301330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 310/621] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:49 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:49.936669 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:49.937298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:49.945574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:49.946040 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:49.946823 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:49.947262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.127428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:50.136791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e932b112-9cea-41e5-b870-6938936bc149 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.203814 Jul 28 22:32:50.138272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 312/622] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:49 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:50.309296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:50.310960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:50.321018 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:50.321701 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.322489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:50.327634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:50.328257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:50.328431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.340400 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:50.340862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.341711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:50.342201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.392353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:50.394010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:50.394731 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lazy-loading 'fault' on Instance uuid 782b475d-87bc-47f5-9cc2-4245086dc6c4 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:32:50.485603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:50.499651 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:50.501991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:50.503197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d74a6825-6ea4-437b-b613-1ef51e783680 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 200 len: 1370 microversion: 2.20 time: 0.179500 Jul 28 22:32:50.511129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 313/623] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:50 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:50.597078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:50.611024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7a82c574-2b9c-4f40-ab6e-43dcdd4503ed tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1681 microversion: 2.1 time: 0.306358 Jul 28 22:32:50.611764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 311/624] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:50 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:50.874697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8d3ed998-f4a0-476a-bbeb-bbeaeaa711b9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Action: 'create', calling method: .version_select at 0x7f743c206430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1305921694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkrzxtmYX6+bSbCFVnn8lR0V39yw4GnKwnlvDq6mHh+guKcrcLUvYwDB1HFH22aWBGToPGVPnWmHXFyrbviuIdrRUYMFWt5CPlk54ytpgRRL97wmqY/h/0fAafVw3BM+g=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:50.894716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-8d3ed998-f4a0-476a-bbeb-bbeaeaa711b9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:32:50.899495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-8d3ed998-f4a0-476a-bbeb-bbeaeaa711b9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for user 32eadc02f9224eb28303aab25506ef2a and project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:32:50.928197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8d3ed998-f4a0-476a-bbeb-bbeaeaa711b9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.287179 Jul 28 22:32:50.937310 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 314/625] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:32:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:51.161911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:51.163897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:51.172881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.173361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.174162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.174595 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.397145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:51.406048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5c9dc000-fd65-4259-a7fe-434ccefe9bd6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1736 microversion: 2.1 time: 0.249459 Jul 28 22:32:51.407598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 312/626] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:51 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:51.529206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:51.529844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:51.538009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.538457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.539229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.539720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.564217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 HTTP/1.1 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:32:51.566515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:32:51.568246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '782b475d-87bc-47f5-9cc2-4245086dc6c4'} Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:51.569139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:32:51.570399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:51.573146 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:51.574247 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-eec4d7e3-c4a5-42df-8af0-e1e5c415adae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 404 len: 111 microversion: 2.20 time: 0.050168 Jul 28 22:32:51.578438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 315/627] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:51 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:32:51.586310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ccba9321-81c7-47fe-9b63-a9e1a4d238b4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '.version_select at 0x7f743c1e88b0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:51.618650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-14c05c5f-5039-4519-95df-244ee48008d6 req-15513418-696d-424a-84b7-eee3a96f0008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e2af9e-d8ce-4edd-8aae-4158d00ef92f", "name": "network-vif-deleted", "tag": "3a6a91e7-1223-4e3c-8af2-8617d06c63d2"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:51.626148 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:51.633097 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-14c05c5f-5039-4519-95df-244ee48008d6 req-15513418-696d-424a-84b7-eee3a96f0008 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.633926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-14c05c5f-5039-4519-95df-244ee48008d6 req-15513418-696d-424a-84b7-eee3a96f0008 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.665409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-14c05c5f-5039-4519-95df-244ee48008d6 req-15513418-696d-424a-84b7-eee3a96f0008 service nova] Creating event network-vif-deleted:3a6a91e7-1223-4e3c-8af2-8617d06c63d2 for instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f on hv-cinder-85093 Jul 28 22:32:51.674106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-14c05c5f-5039-4519-95df-244ee48008d6 req-15513418-696d-424a-84b7-eee3a96f0008 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060183 Jul 28 22:32:51.675440 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 316/628] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:51.687364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ccba9321-81c7-47fe-9b63-a9e1a4d238b4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837565009" status: 204 len: 0 microversion: 2.20 time: 0.101703 Jul 28 22:32:51.689161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:51.690271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:51.690540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 313/629] 10.222.0.39 () {60 vars in 1259 bytes} [Thu Jul 28 22:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837565009 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 22:32:51.718882 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.722954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.723914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:51.724500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:51.856723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:51.868283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6e6b0ce3-82c1-4e10-a6f8-d858108ba34c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 200 len: 1325 microversion: 2.1 time: 0.191267 Jul 28 22:32:51.876233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 317/630] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:51 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:52.429482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:52.431352 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:52.434515 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:32:52.456753 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.460245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.461714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.462630 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.708301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:52.716897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b9f9a267-e93c-44d5-b7c3-2f174d96e84c tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1716 microversion: 2.1 time: 0.292357 Jul 28 22:32:52.720003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 314/631] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:52 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1716 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:52.898519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:52.900409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:52.908734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:52.909327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:52.921033 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.921926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.922962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.923608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.926074 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.928689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.929589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:52.930029 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:52.958788 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f HTTP/1.1 Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:32:52.973903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:32:52.975246 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '41e2af9e-d8ce-4edd-8aae-4158d00ef92f'} Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:52.975986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:32:52.977121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:32:52.980558 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:52.980558 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-92d4c240-017a-44e1-811b-4dea11cd0f67 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 404 len: 111 microversion: 2.1 time: 0.083959 Jul 28 22:32:52.980558 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 318/632] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:52 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:32:52.991413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-44a22ff1-ea64-45da-bd71-f3616132947b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '.version_select at 0x7f743c17be50>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:53.037198 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-44a22ff1-ea64-45da-bd71-f3616132947b tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331479206" status: 202 len: 0 microversion: 2.1 time: 0.053997 Jul 28 22:32:53.038890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 319/633] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Jul 28 22:32:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331479206 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:53.046159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-724bd881-bb08-4507-b523-c2ea0b464b46 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: .version_select at 0x7f743c206160>, body: {"keypair": {"name": "tempest-keypair-791566338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl0k8j3ix/XhJ61iFgGdYRczEYWwyqAGiRYiS7gsIuoTmwe3dCUwpBYsnX40hTCbE1NM5rZl/gV5yMiP47EN9LbBL6QKn9mVHcB26uZJS4IsvDxCSCc4o5t8WKSG0ItEA=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:53.071481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-724bd881-bb08-4507-b523-c2ea0b464b46 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:32:53.075815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-724bd881-bb08-4507-b523-c2ea0b464b46 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for user b7e13e8c76cb4757a42568112d16bd27 and project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:32:53.103856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-724bd881-bb08-4507-b523-c2ea0b464b46 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.063523 Jul 28 22:32:53.104842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 320/634] 10.222.0.39 () {62 vars in 1200 bytes} [Thu Jul 28 22:32:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 22:32:53.126568 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] HTTP exception thrown: Cannot 'detach_volume' instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 while it is in vm_state rescued Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Request method failure captured: Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments/1e4ada87-179c-44d7-8fb6-be4b33d22a98 HTTP/1.1 Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2EPQwi9LUIU2KcR-VvJEOLzgVj_DvzhxqYGxPdqGF3mhyBtTVexK0B28hZ7RtOR_nsdh4svsGv4FiHSMsIi-PlE_OhxfHhTaB3sonqLZllTwI1EjGZRoyaoBkxrxF81nzcBWHie4d1GWaqGLp_Ad_7_8aX77KoIDxcvcPQxDfvMIg Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:32:53.129518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: afbab63bf079403b8ef652422d581d25 Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:32:53.131382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Cannot 'detach_volume' instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 while it is in vm_state rescued Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'server_id': 'b55a65b2-1c47-4b8b-9298-f7ba3c7acba7', 'id': '1e4ada87-179c-44d7-8fb6-be4b33d22a98'} Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:32:53.132181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 while it is in vm_state rescued Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 while it is in vm_state rescued Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:32:53.133613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Returning 409 to user: Cannot 'detach_volume' instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 while it is in vm_state rescued {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:32:53.134842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8a42f38a-8fd4-4ec0-a297-bd31fedd4f5e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments/1e4ada87-179c-44d7-8fb6-be4b33d22a98" status: 409 len: 152 microversion: 2.1 time: 0.229017 Jul 28 22:32:53.135588 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 315/635] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:32:52 2022] DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments/1e4ada87-179c-44d7-8fb6-be4b33d22a98 => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 22:32:53.145471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:53.146449 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:53.159295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:53.159962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:53.161549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:53.162830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:53.266278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-83dbad43-83cf-4c43-9d17-a81e7c0058ad tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/action" status: 202 len: 0 microversion: 2.1 time: 0.124539 Jul 28 22:32:53.269344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 321/636] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:32:53 2022] POST /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:32:53.279325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:53.280102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:53.288980 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:53.289468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:53.290364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:53.290902 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:53.529923 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:53.540039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9baca0b4-83f9-4462-8d8e-5dda7f9375d1 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1724 microversion: 2.1 time: 0.265081 Jul 28 22:32:53.541320 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 316/637] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:53 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:54.255025 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-241cfbbc-74e2-4ec4-8d9c-21d472e2893f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: .version_select at 0x7f743c334af0>, body: {"keypair": {"name": "tempest-keypair-524304912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiRTc9wHyopIlptXAPEUEvwKbfKOnVgcEtWv046GObqhfDZryP6AoYWmv37cHAY6H3nF5H2MnUMS0OABfEDZYrW7X/yo6F554WxukgJzU2SCFq0QLgde38UQqGm7So+ew=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:54.280023 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-241cfbbc-74e2-4ec4-8d9c-21d472e2893f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:32:54.284192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-241cfbbc-74e2-4ec4-8d9c-21d472e2893f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:32:54.311248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-241cfbbc-74e2-4ec4-8d9c-21d472e2893f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065258 Jul 28 22:32:54.311844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 322/638] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:32:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:32:54.574280 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:54.580872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:54.598845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:54.599312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:54.600099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:54.600544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:54.984419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:55.010801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9c8aa463-93d1-4a78-930c-f409d3bc13a7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1724 microversion: 2.1 time: 0.448177 Jul 28 22:32:55.011846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 317/639] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:54 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:55.731381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1706225684", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "425ace09-193c-40d9-ace1-b357fa18c983"}], "security_groups": [{"name": "tempest-securitygroup--1797286384"}], "key_name": "tempest-keypair-791566338", "user_data": "}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:56.035356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:56.036637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:56.043518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:56.044236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:56.045224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:56.045837 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:56.182312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] validate_networks() for [('425ace09-193c-40d9-ace1-b357fa18c983', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:32:56.336344 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:56.344984 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9db00abe-d881-4095-b320-569eb9c6c588 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1724 microversion: 2.1 time: 0.313562 Jul 28 22:32:56.345573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 318/640] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:56 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:56.350773 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036287580", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ba94cd9-b91a-4088-b65d-e5c882850ab5"}], "security_groups": [{"name": "tempest-securitygroup--1656954774"}], "key_name": "tempest-keypair-524304912", "user_data": "}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:56.516879 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] validate_networks() for [('6ba94cd9-b91a-4088-b65d-e5c882850ab5', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:32:56.779820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:32:56.780307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:32:56.780845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:32:56.781328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:32:56.781859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:32:56.791495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:56.792040 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:56.793301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:56.793849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:56.813417 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:32:56.818387 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Getting quotas for user b7e13e8c76cb4757a42568112d16bd27 and project 9c4e68e56e744fa9af4631ae2e967a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:32:56.829505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:32:56.831951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:32:56.878807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-98c07628-3f2b-4ee3-9296-622e344e47aa tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.152672 Jul 28 22:32:56.885677 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 323/641] 10.222.0.39 () {62 vars in 1188 bytes} [Thu Jul 28 22:32:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 22:32:56.891532 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:56.892247 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:56.985638 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:56.997171 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:56.998741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:57.000049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1d66f229-33f5-4b12-b66b-37214e330783 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1281 microversion: 2.20 time: 0.113068 Jul 28 22:32:57.000780 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 324/642] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:56 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:57.026174 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:32:57.026606 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:32:57.027091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:32:57.027501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:32:57.027916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:32:57.037774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.038309 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.039023 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.039463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.057506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:32:57.061571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:32:57.073300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:32:57.075826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:32:57.126174 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5f21fd3b-1438-4415-941b-6c5f124161cb tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779541 Jul 28 22:32:57.129983 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 319/643] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:32:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:32:57.138363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7ebdbe5b-3b1c-4e8e-af03-c35436921501 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:57.139121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7ebdbe5b-3b1c-4e8e-af03-c35436921501 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:57.233166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7ebdbe5b-3b1c-4e8e-af03-c35436921501 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:57.241775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7ebdbe5b-3b1c-4e8e-af03-c35436921501 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1241 microversion: 2.1 time: 0.107406 Jul 28 22:32:57.246332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 325/644] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:57 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:57.368653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:57.369724 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:57.378405 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.379102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.381459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.381926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.532079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:57.542553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5057eaf2-696a-4ad3-a4be-45439a4ea1b6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1730 microversion: 2.1 time: 0.179431 Jul 28 22:32:57.543132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 320/645] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:57 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:57.564509 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:57.565021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:57.572071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.572715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.573803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:57.574475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:57.658453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7aeac32d-e88a-4a98-b303-acc72f206537 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098660 Jul 28 22:32:57.659037 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 326/646] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:32:57 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:58.025158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:58.026913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:58.048010 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:58.049959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:58.054348 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:58.057636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:58.167402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:58.181639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:58.183499 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:58.186263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d990777f-169c-443b-a744-a937fef98b86 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1351 microversion: 2.20 time: 0.168287 Jul 28 22:32:58.187480 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 321/647] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:58 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:58.264368 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:58.265103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:58.272458 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:58.273111 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:58.274479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:58.274685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:58.352673 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:58.360988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7e11a36c-c528-418e-a4bd-fbdd9fb4bf40 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1293 microversion: 2.1 time: 0.100549 Jul 28 22:32:58.361978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 327/648] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:58 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:32:58.691324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-d3c3df83-5c17-483e-b753-13746b6ca9f8 req-1f650811-3726-40e1-a76e-ce3101beb485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:32:58.709912 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-d3c3df83-5c17-483e-b753-13746b6ca9f8 req-1f650811-3726-40e1-a76e-ce3101beb485 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:58.718421 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-d3c3df83-5c17-483e-b753-13746b6ca9f8 req-1f650811-3726-40e1-a76e-ce3101beb485 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:58.745740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-d3c3df83-5c17-483e-b753-13746b6ca9f8 req-1f650811-3726-40e1-a76e-ce3101beb485 service nova] Creating event network-changed:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:32:58.755754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-d3c3df83-5c17-483e-b753-13746b6ca9f8 req-1f650811-3726-40e1-a76e-ce3101beb485 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066979 Jul 28 22:32:58.756755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 322/649] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:32:59.210801 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:59.211409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:59.217392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:59.218163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:59.219162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:59.219857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:59.376487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:59.385554 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:32:59.386367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:32:59.393756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:59.394024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:59.394652 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:59.396311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:32:59.396949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:32:59.397304 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:59.399605 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8a1dcd85-ccdc-4349-9473-e608de833f76 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.193383 Jul 28 22:32:59.401293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 328/650] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:32:59 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:32:59.490857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:32:59.502007 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e2105655-2351-4924-88a8-34100e7defac tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1299 microversion: 2.1 time: 0.122596 Jul 28 22:32:59.521957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 323/651] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:32:59 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:00.423306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:00.424067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:00.431772 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:00.432266 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:00.433104 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:00.433591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:00.537550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:00.538446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:00.548239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:00.548857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:00.549809 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:00.550313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:00.587782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:00.597815 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:00.599630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:00.601024 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-de62352f-a570-4ac0-bfd9-25b6be89b4af tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.181675 Jul 28 22:33:00.601765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 329/652] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:00 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:00.779917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-f9e4ecad-547a-4c8c-86d3-02b018305824 req-8d3b1e1f-25b4-4c76-9ce8-6ff965fe42b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:00.789238 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:00.793704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f9e4ecad-547a-4c8c-86d3-02b018305824 req-8d3b1e1f-25b4-4c76-9ce8-6ff965fe42b9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:00.794165 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f9e4ecad-547a-4c8c-86d3-02b018305824 req-8d3b1e1f-25b4-4c76-9ce8-6ff965fe42b9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:00.797738 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9c96c699-ec9f-4776-b397-26ba7c9e7d06 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.271923 Jul 28 22:33:00.801887 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 324/653] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:00 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:00.810503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-f9e4ecad-547a-4c8c-86d3-02b018305824 req-8d3b1e1f-25b4-4c76-9ce8-6ff965fe42b9 service nova] Creating event network-changed:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:33:00.815738 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-f9e4ecad-547a-4c8c-86d3-02b018305824 req-8d3b1e1f-25b4-4c76-9ce8-6ff965fe42b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039601 Jul 28 22:33:00.816717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 330/654] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:01.087334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-3a12de59-49b7-489d-b725-c431e1c1f500 req-cd93c618-17b7-4172-a381-bd30038bd968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:01.096880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-3a12de59-49b7-489d-b725-c431e1c1f500 req-cd93c618-17b7-4172-a381-bd30038bd968 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:01.097374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-3a12de59-49b7-489d-b725-c431e1c1f500 req-cd93c618-17b7-4172-a381-bd30038bd968 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:01.102384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:01.110401 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-3a12de59-49b7-489d-b725-c431e1c1f500 req-cd93c618-17b7-4172-a381-bd30038bd968 service nova] Creating event network-changed:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:33:01.116059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-3a12de59-49b7-489d-b725-c431e1c1f500 req-cd93c618-17b7-4172-a381-bd30038bd968 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033723 Jul 28 22:33:01.117015 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 325/655] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:01.635934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:01.637622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:01.647648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:01.648550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:01.649713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:01.650890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:01.792932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:01.801715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:01.803914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:01.805078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-503a6073-f422-4ca7-bb7e-20cee96cca8a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.174037 Jul 28 22:33:01.805667 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 331/656] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:01 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:01.821853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:01.822697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:01.830304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:01.830981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:01.831750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:01.832181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:01.974825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:01.982291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-971f91f7-8ab1-449c-bb0d-d8776ead09fd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.166257 Jul 28 22:33:01.982854 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 326/657] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:01 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:02.828770 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:02.829303 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:02.836778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:02.837282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:02.838178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:02.838622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:02.974448 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:02.982366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:02.983894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:02.985013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-793a2c3c-2005-4e49-a478-8cefcd29e06d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.160522 Jul 28 22:33:02.985586 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 332/658] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:02 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:03.005518 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:03.006304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:03.013872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:03.014482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:03.015347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:03.015858 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:03.151249 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-02986d31-67c4-4456-9bf7-90bf6ab88b43 req-a7526b8c-422b-4990-b804-2c600402495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02901dd1-28e3-486f-a09c-3af63e2e81f2", "tag": "928ca1a1-5c7c-4967-ac84-b4ef57e684ed"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:03.162248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-02986d31-67c4-4456-9bf7-90bf6ab88b43 req-a7526b8c-422b-4990-b804-2c600402495e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:03.162700 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-02986d31-67c4-4456-9bf7-90bf6ab88b43 req-a7526b8c-422b-4990-b804-2c600402495e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:03.173680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-02986d31-67c4-4456-9bf7-90bf6ab88b43 req-a7526b8c-422b-4990-b804-2c600402495e service nova] Creating event network-changed:928ca1a1-5c7c-4967-ac84-b4ef57e684ed for instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 on hv-cinder-85093 Jul 28 22:33:03.178474 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-02986d31-67c4-4456-9bf7-90bf6ab88b43 req-a7526b8c-422b-4990-b804-2c600402495e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030896 Jul 28 22:33:03.179073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 333/659] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:03.242820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:03.251079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-42168158-64f8-41e5-9c9d-851f950baa6e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.250734 Jul 28 22:33:03.251664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 327/660] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:02 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:04.009953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:04.010650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:04.016706 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:04.017151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:04.017942 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:04.018377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:04.217960 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:04.227348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:04.228944 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:04.230169 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-266c540c-684f-40f2-9a62-0f5071544e26 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.225650 Jul 28 22:33:04.230814 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 334/661] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:04 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:04.273865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:04.274571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:04.281981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:04.282425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:04.283190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:04.283813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:04.433817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:04.441237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-12b24cdd-2437-4131-aafe-ff8f456dfc32 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.171924 Jul 28 22:33:04.441898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 328/662] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:04 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:05.255890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:05.256917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:05.263916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:05.264363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:05.265132 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:05.265597 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:05.397938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:05.406866 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:05.408374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:05.410116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ec45a8be-90bf-436a-9c8e-f67ecd043207 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.158863 Jul 28 22:33:05.411785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 335/663] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:05 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:05.463227 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:05.463831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:05.470073 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:05.470514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:05.471259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:05.471689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:05.598756 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:05.606319 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1577fc50-040f-47e5-9ebc-386b933827d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.147041 Jul 28 22:33:05.606887 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 329/664] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:05 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:06.435600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:06.436122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:06.442890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:06.443346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:06.444116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:06.444566 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:06.463162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:06.577335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:06.586113 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:06.587637 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:06.588742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9895f01e-989d-4cb4-b965-65b1daecc641 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.157208 Jul 28 22:33:06.589306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 336/665] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:06 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:06.626185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:06.626799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:06.634486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:06.634937 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:06.635691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:06.636151 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:06.763715 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:06.772362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2c48d27a-9b5d-4f5c-80bd-a0b23d00b7df tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.149984 Jul 28 22:33:06.772930 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 330/666] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:06 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:07.432238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-60de0209-69b3-4b2e-a43c-f9e73c7d7383 req-09b67e81-3f57-46d2-8acc-d765dcccc5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "name": "network-vif-plugged", "status": "completed", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:07.437152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:07.437894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=22 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:07.444026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-60de0209-69b3-4b2e-a43c-f9e73c7d7383 req-09b67e81-3f57-46d2-8acc-d765dcccc5c1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:07.444519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-60de0209-69b3-4b2e-a43c-f9e73c7d7383 req-09b67e81-3f57-46d2-8acc-d765dcccc5c1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:07.457957 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-60de0209-69b3-4b2e-a43c-f9e73c7d7383 req-09b67e81-3f57-46d2-8acc-d765dcccc5c1 service nova] Creating event network-vif-plugged:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:33:07.463150 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-60de0209-69b3-4b2e-a43c-f9e73c7d7383 req-09b67e81-3f57-46d2-8acc-d765dcccc5c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 Jul 28 22:33:07.463816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 337/667] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:33:07.611244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:07.611846 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:07.613853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:07.614570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=6 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:07.620456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:07.620898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:07.621688 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:07.622118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:07.765057 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:07.775333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:07.776780 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:07.777945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b23dbeaa-24bb-4e0d-ab89-fbc32ae0d467 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.170739 Jul 28 22:33:07.778508 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 331/668] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:07 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:07.794059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:07.795015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:07.802592 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:07.803331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:07.804118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:07.804563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:07.937080 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:07.945264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a507083e-9843-4d93-bf7d-0eca3485a13f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.156429 Jul 28 22:33:07.945873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 338/669] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:07 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:08.803977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:08.804614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:08.811041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:08.811491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:08.812240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:08.812673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:08.939502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:08.947967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:08.949468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:08.950581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-24267d3c-762d-48c2-9214-c682a2839305 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1407 microversion: 2.20 time: 0.150885 Jul 28 22:33:08.951157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 332/670] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:08 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:33:08.966678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:08.967298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:08.974442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:08.974892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:08.975659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:08.976098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:09.111686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:09.120022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cef8835c-3fd7-4056-8ba4-1d04b8427f11 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.157123 Jul 28 22:33:09.120589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 339/671] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:08 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:09.161355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1071080214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305921694", "security_groups": [{"name": "tempest-secgroup-smoke-1337180336"}], "block_device_mapping_v2": [{"uuid": "0ac9a069-3311-4f99-8c87-673b861d9ecb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e"}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:09.277391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] validate_networks() for [('ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:33:09.493255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-b253bdab-3cc7-42c8-8e8c-0ae3178d0d09 req-444dd47b-74e1-41a7-854f-c47f09ae36b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02901dd1-28e3-486f-a09c-3af63e2e81f2", "name": "network-vif-plugged", "status": "completed", "tag": "928ca1a1-5c7c-4967-ac84-b4ef57e684ed"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:09.502697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-b253bdab-3cc7-42c8-8e8c-0ae3178d0d09 req-444dd47b-74e1-41a7-854f-c47f09ae36b7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:09.503145 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-b253bdab-3cc7-42c8-8e8c-0ae3178d0d09 req-444dd47b-74e1-41a7-854f-c47f09ae36b7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:09.514442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-b253bdab-3cc7-42c8-8e8c-0ae3178d0d09 req-444dd47b-74e1-41a7-854f-c47f09ae36b7 service nova] Creating event network-vif-plugged:928ca1a1-5c7c-4967-ac84-b4ef57e684ed for instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 on hv-cinder-85093 Jul 28 22:33:09.519271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-b253bdab-3cc7-42c8-8e8c-0ae3178d0d09 req-444dd47b-74e1-41a7-854f-c47f09ae36b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029631 Jul 28 22:33:09.520407 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 340/672] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:33:09.648861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:33:09.649283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:33:09.649788 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:33:09.650199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:33:09.650625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:33:09.659350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:09.659793 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:09.661412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:09.661868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:09.679082 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:33:09.684695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for user 32eadc02f9224eb28303aab25506ef2a and project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:33:09.743685 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:33:09.745803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ac9a069-3311-4f99-8c87-673b861d9ecb',volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:33:09.898433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a3c85059-72da-43e7-bb30-681b603603e1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741001 Jul 28 22:33:09.899407 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 333/673] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:33:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:33:09.912565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e9f6d9d3-21ba-4dc6-a5fa-a048ce13d279 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:09.913478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e9f6d9d3-21ba-4dc6-a5fa-a048ce13d279 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:09.973898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:09.974053 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e9f6d9d3-21ba-4dc6-a5fa-a048ce13d279 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:09.974510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:09.982269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e9f6d9d3-21ba-4dc6-a5fa-a048ce13d279 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1095 microversion: 2.1 time: 0.075800 Jul 28 22:33:09.983095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 341/674] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:09 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:09.983712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:09.985479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:09.986853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:09.987337 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:10.137107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:10.141542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:10.142194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:10.151553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:10.152289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:10.153065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:10.153208 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:10.153671 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:10.154594 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:10.157857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a0132258-4db9-40d2-9702-2f3b054205bf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1600 microversion: 2.20 time: 0.188091 Jul 28 22:33:10.158403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 334/675] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:09 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:33:10.181489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:10.182193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:10.188731 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:10.189368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:10.190325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:10.190913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:10.302622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-40c0fafc-7a10-43ba-8f2c-6591e4abbcd2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124802 Jul 28 22:33:10.303346 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 335/676] 10.222.0.39 () {60 vars in 1316 bytes} [Thu Jul 28 22:33:10 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:33:10.340475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:10.350069 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-53b30c73-2d79-47ae-b29a-50e2129e1bb1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.212724 Jul 28 22:33:10.351800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 342/677] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:10 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:11.004192 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:11.005264 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:11.011493 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:11.011957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:11.012748 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:11.013178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:11.079132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:11.086938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4c3d87a4-0b9a-49af-ba45-96879db12fb5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1193 microversion: 2.1 time: 0.087213 Jul 28 22:33:11.087512 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 336/678] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:10 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:11.372263 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:11.372993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:11.380235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:11.380678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:11.381434 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:11.381962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:11.478060 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-b6d6cdb9-dd94-40f8-93de-24a8ae071d29 req-7a134afc-0265-4be2-8966-7ded32d8d42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:11.490854 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-b6d6cdb9-dd94-40f8-93de-24a8ae071d29 req-7a134afc-0265-4be2-8966-7ded32d8d42d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:11.491577 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-b6d6cdb9-dd94-40f8-93de-24a8ae071d29 req-7a134afc-0265-4be2-8966-7ded32d8d42d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:11.510926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-b6d6cdb9-dd94-40f8-93de-24a8ae071d29 req-7a134afc-0265-4be2-8966-7ded32d8d42d service nova] Creating event network-changed:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:33:11.521563 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-b6d6cdb9-dd94-40f8-93de-24a8ae071d29 req-7a134afc-0265-4be2-8966-7ded32d8d42d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049864 Jul 28 22:33:11.522759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 337/679] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:11.568522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:11.576396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2aa461ee-6ad2-4932-8b93-37087ed2bb21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1367 microversion: 2.1 time: 0.208040 Jul 28 22:33:11.577108 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 343/680] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:11 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:12.110530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:12.112040 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:12.122897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.123481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.124367 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.124908 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.213689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:12.228976 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-33c23975-8d28-4bd2-bd81-0969eac024cd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1211 microversion: 2.1 time: 0.123614 Jul 28 22:33:12.230165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 338/681] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:12 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:12.598836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:12.599467 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:12.603054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:12.607390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.608048 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.608873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.609487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.775924 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:12.786799 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-064e2bf2-bc76-4b22-b91b-d0991dcb40aa tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1558 microversion: 2.1 time: 0.192523 Jul 28 22:33:12.787395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 344/682] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:12 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:12.808084 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:12.808861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:12.816032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.816765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.817739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:12.818323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:12.899820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-eb05e6d2-3fbb-4ea8-adf8-ea2d603437cf tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095559 Jul 28 22:33:12.901557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 339/683] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:33:12 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:13.252198 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:13.253179 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:13.259986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:13.260653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:13.261624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:13.262060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:13.339621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:13.348316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-24fda026-62b6-4eb9-9ff9-eaf2506d2566 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1199 microversion: 2.1 time: 0.099123 Jul 28 22:33:13.349489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 345/684] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:13 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:14.159048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-bb87ecd1-8faa-4d36-8fd8-f09359bf0382 req-b883743a-f2d6-4e43-a29b-8bb53dc25724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02901dd1-28e3-486f-a09c-3af63e2e81f2", "tag": "928ca1a1-5c7c-4967-ac84-b4ef57e684ed"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:14.169354 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-bb87ecd1-8faa-4d36-8fd8-f09359bf0382 req-b883743a-f2d6-4e43-a29b-8bb53dc25724 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:14.169827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-bb87ecd1-8faa-4d36-8fd8-f09359bf0382 req-b883743a-f2d6-4e43-a29b-8bb53dc25724 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:14.181218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-bb87ecd1-8faa-4d36-8fd8-f09359bf0382 req-b883743a-f2d6-4e43-a29b-8bb53dc25724 service nova] Creating event network-changed:928ca1a1-5c7c-4967-ac84-b4ef57e684ed for instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 on hv-cinder-85093 Jul 28 22:33:14.186155 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-bb87ecd1-8faa-4d36-8fd8-f09359bf0382 req-b883743a-f2d6-4e43-a29b-8bb53dc25724 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031174 Jul 28 22:33:14.187077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 340/685] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:14.369314 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:14.369939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:14.376599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:14.377036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:14.377931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:14.378364 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:14.531495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:14.547022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fd8ddaa0-52eb-4102-b3ae-7e57658eb8c4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.181406 Jul 28 22:33:14.547618 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 346/686] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:14 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:14.953867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-c95edac6-ca62-4194-89aa-d60a11ec6b1e req-65972c54-4e57-464c-a00a-6d8740241069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47525846-7437-4e19-acd2-70f0ea466207", "tag": "ac87f497-4264-4cef-8637-fb0c985ee2c9"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:14.984774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c95edac6-ca62-4194-89aa-d60a11ec6b1e req-65972c54-4e57-464c-a00a-6d8740241069 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:14.985559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c95edac6-ca62-4194-89aa-d60a11ec6b1e req-65972c54-4e57-464c-a00a-6d8740241069 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:15.005658 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c95edac6-ca62-4194-89aa-d60a11ec6b1e req-65972c54-4e57-464c-a00a-6d8740241069 service nova] Creating event network-changed:ac87f497-4264-4cef-8637-fb0c985ee2c9 for instance 47525846-7437-4e19-acd2-70f0ea466207 on hv-cinder-85093 Jul 28 22:33:15.011708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-c95edac6-ca62-4194-89aa-d60a11ec6b1e req-65972c54-4e57-464c-a00a-6d8740241069 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066936 Jul 28 22:33:15.013024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 341/687] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:15.569034 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:15.569682 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:15.576389 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:15.576837 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:15.577635 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:15.578075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:15.712711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:15.720256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e0ade10f-ac46-44c3-a8ff-815e189e4bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.155880 Jul 28 22:33:15.720821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 347/688] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:15 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:16.742006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:16.742699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:16.748929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:16.749377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:16.750160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:16.750615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:16.880702 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:16.888273 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5fcb6804-dc8e-4151-8ecd-8c4d5adf7eb0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.151126 Jul 28 22:33:16.888839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 342/689] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:16 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:17.910758 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:17.911402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:17.918069 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:17.918523 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:17.919282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:17.919719 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:18.049933 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:18.057729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5a0fe0bf-fb5e-4af7-b89d-fa841a055fbc tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.150824 Jul 28 22:33:18.058288 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 348/690] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:17 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:19.079224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:19.079765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:19.087426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:19.087877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:19.088638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:19.089075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:19.220386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:19.228429 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-66464f44-969f-4ba8-b03a-b8c6abfb6e73 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.153225 Jul 28 22:33:19.228994 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 343/691] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:19 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:20.248290 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:20.248907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:20.251261 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:20.257065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.257544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.258312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.258751 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.390216 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:20.398296 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5a82cc6b-1527-4427-95a1-161dcfc1509d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.153915 Jul 28 22:33:20.398809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 349/692] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:20 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:20.670770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:20.673077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:20.675077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:20.675737 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=6 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:20.682827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.683279 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.684050 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.684497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.714894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-85deca5b-628d-49c8-ab29-9ebcf1dde15c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048024 Jul 28 22:33:20.715476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 344/693] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:33:20 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:33:20.779329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:20.779832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:20.786866 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.787325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.788094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.788533 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.813853 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:33:20.887258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ea84087c-cf41-44ab-992a-807dfc7b95a1 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 204 len: 0 microversion: 2.1 time: 0.111507 Jul 28 22:33:20.887828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 350/694] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:33:20 2022] DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:33:20.897206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:20.898407 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:20.906082 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.906470 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:20.907242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:20.907683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:21.045312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:21.048947 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:21.054850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e61ad6e9-a698-4d60-b67f-d6e97d30bd87 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1674 microversion: 2.1 time: 0.162258 Jul 28 22:33:21.055429 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 345/695] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:20 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:21.419257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:21.419971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:21.426690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:21.427154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:21.427934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:21.428379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:21.557386 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:21.564869 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f843f710-b715-47f5-af46-570efee7baf1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.149960 Jul 28 22:33:21.565439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 351/696] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:21 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:22.077797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:22.079277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:22.087222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:22.087668 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:22.088495 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:22.088932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:22.253884 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:22.263191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f4c9085c-7ae2-4a7e-9dff-b1e149d4f748 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1674 microversion: 2.1 time: 0.190604 Jul 28 22:33:22.263759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 346/697] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:22 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:22.587290 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:22.588005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:22.594607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:22.595054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:22.595810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:22.596242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:22.734893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:22.742390 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-aa077c4f-1547-4fcd-a57c-5b1a0fa4535b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.159643 Jul 28 22:33:22.742963 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 352/698] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:22 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:23.286084 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:23.286776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:23.289214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:23.294794 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:23.295235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:23.295999 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:23.296428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:23.430145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:23.437685 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-64a7132c-65e6-449f-aadd-f229123d1a15 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1674 microversion: 2.1 time: 0.155844 Jul 28 22:33:23.438254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 347/699] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:23 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:23.763141 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:23.763747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:23.770328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:23.770783 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:23.771549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:23.771993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:23.912477 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:23.915988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:23.920903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d6902747-f515-479b-b8b6-ad0d670cd4fb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.161600 Jul 28 22:33:23.921475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 353/700] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:23 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:24.460572 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:24.461939 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:24.468803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:24.469067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:24.469882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:24.470324 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:24.606975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:24.615284 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-fb192c80-981a-4b5a-882b-3311f2fd5392 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 200 len: 1674 microversion: 2.1 time: 0.159517 Jul 28 22:33:24.616101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 348/701] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:24 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:24.916828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-3860fbbc-b631-440e-a546-ed403d0fe345 req-c8f6baf0-207e-402c-a3a1-d69e7290d8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc2682a-cbca-49c8-8e74-2d9ed7062e93", "name": "network-vif-deleted", "tag": "35af7134-fcd8-416d-b6f7-11f5d93a4613"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:24.929120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3860fbbc-b631-440e-a546-ed403d0fe345 req-c8f6baf0-207e-402c-a3a1-d69e7290d8fd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:24.929595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3860fbbc-b631-440e-a546-ed403d0fe345 req-c8f6baf0-207e-402c-a3a1-d69e7290d8fd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:24.941859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-3860fbbc-b631-440e-a546-ed403d0fe345 req-c8f6baf0-207e-402c-a3a1-d69e7290d8fd service nova] Creating event network-vif-deleted:35af7134-fcd8-416d-b6f7-11f5d93a4613 for instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 on hv-cinder-85093 Jul 28 22:33:24.942711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:24.943699 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:24.947190 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-3860fbbc-b631-440e-a546-ed403d0fe345 req-c8f6baf0-207e-402c-a3a1-d69e7290d8fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Jul 28 22:33:24.947857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 354/702] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:24.950796 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:24.951434 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:24.952543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:24.952990 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:25.124775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:25.134244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6b1ddddd-21c6-4e23-9272-fa342d1766d5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.195925 Jul 28 22:33:25.134831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 349/703] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:24 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:25.396375 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-bbba1630-3cf6-41fc-ab82-9ce944070017 req-8a111bca-ccf5-4cf9-99d0-3866fc1128ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47525846-7437-4e19-acd2-70f0ea466207", "name": "network-vif-plugged", "status": "completed", "tag": "ac87f497-4264-4cef-8637-fb0c985ee2c9"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:25.406440 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bbba1630-3cf6-41fc-ab82-9ce944070017 req-8a111bca-ccf5-4cf9-99d0-3866fc1128ff service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:25.407069 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bbba1630-3cf6-41fc-ab82-9ce944070017 req-8a111bca-ccf5-4cf9-99d0-3866fc1128ff service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:25.422893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-bbba1630-3cf6-41fc-ab82-9ce944070017 req-8a111bca-ccf5-4cf9-99d0-3866fc1128ff service nova] Creating event network-vif-plugged:ac87f497-4264-4cef-8637-fb0c985ee2c9 for instance 47525846-7437-4e19-acd2-70f0ea466207 on hv-cinder-85093 Jul 28 22:33:25.431067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-bbba1630-3cf6-41fc-ab82-9ce944070017 req-8a111bca-ccf5-4cf9-99d0-3866fc1128ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040156 Jul 28 22:33:25.431775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 355/704] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:25.637426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:25.638897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:25.647212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:25.647667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:25.648616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:25.649049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:25.664322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 HTTP/1.1 Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:33:25.665968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:33:25.667679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '8cc2682a-cbca-49c8-8e74-2d9ed7062e93'} Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:33:25.668709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:33:25.670228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:25.671712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:33:25.671712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-55be2086-b196-4965-8ee6-7be2e2037939 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 404 len: 111 microversion: 2.1 time: 0.033966 Jul 28 22:33:25.671712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 350/705] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:25 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:33:25.678499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-13b5ea68-2140-4a39-94e0-c1b7ef9a0ff5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '.version_select at 0x7f743c0f6ca0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:25.698073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-13b5ea68-2140-4a39-94e0-c1b7ef9a0ff5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203629947" status: 202 len: 0 microversion: 2.1 time: 0.024986 Jul 28 22:33:25.698807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 356/706] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Jul 28 22:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203629947 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:33:26.155539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:26.156437 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:26.163178 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:26.163696 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:26.164523 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:26.165138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:26.304380 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:26.311955 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-175b72fc-8b24-4e9b-9caf-613a517fa2ce tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.160340 Jul 28 22:33:26.312605 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 351/707] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:26 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:26.365016 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2d4eb049-7598-4a29-a911-b01a0eca811d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: .version_select at 0x7f743c319c10>, body: {"keypair": {"name": "tempest-keypair-96214369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE95+teXohpRizhgAJpzT4fHgoTPU1+t12pQVplwzDkM10xIYZ3W65l4eQF2aNbOUqpPXr6EXIy5yDJd8FbRzr+GVschexjs8s4LomcFs9lqGc99Asbmk6o5iWiGABbo5Q=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:26.381617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-2d4eb049-7598-4a29-a911-b01a0eca811d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for project d829cbd8678145668ea811e01093fcfc. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:33:26.385333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-2d4eb049-7598-4a29-a911-b01a0eca811d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for user 7476eccb0a6f4195936bec75f7f80c7d and project d829cbd8678145668ea811e01093fcfc. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:33:26.406164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2d4eb049-7598-4a29-a911-b01a0eca811d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046264 Jul 28 22:33:26.406746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 357/708] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:33:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:27.335651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:27.336284 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:27.343206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:27.343664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:27.344477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:27.344915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:27.561491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:27.571561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7bf5e63d-3746-4c0c-ad4a-fd59533508f2 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1267 microversion: 2.1 time: 0.240706 Jul 28 22:33:27.572144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 352/709] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:27 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:27.707967 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-668486985", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "464fee12-f052-4124-8f6c-243235b340a4"}], "security_groups": [{"name": "tempest-securitygroup--2109996960"}], "key_name": "tempest-keypair-96214369", "user_data": "}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:27.813898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] validate_networks() for [('464fee12-f052-4124-8f6c-243235b340a4', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:33:28.216694 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:33:28.217118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:33:28.217634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:33:28.218045 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:33:28.218455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:33:28.228076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.228532 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.229332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.229811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.246798 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for project d829cbd8678145668ea811e01093fcfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:33:28.250729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Getting quotas for user 7476eccb0a6f4195936bec75f7f80c7d and project d829cbd8678145668ea811e01093fcfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:33:28.262266 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:33:28.264584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:33:28.311198 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-626cac8b-21de-43e4-b927-bc4427d43b9a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608461 Jul 28 22:33:28.311838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 358/710] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:33:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 22:33:28.323227 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-dcdd2de0-7354-4874-a4b9-45432aa420ff tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:28.323834 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-dcdd2de0-7354-4874-a4b9-45432aa420ff tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:28.377891 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dcdd2de0-7354-4874-a4b9-45432aa420ff tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:28.385150 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-dcdd2de0-7354-4874-a4b9-45432aa420ff tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1235 microversion: 2.1 time: 0.065738 Jul 28 22:33:28.385746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 353/711] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:28 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:28.592128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:28.592746 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:28.599341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.599793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.600546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.601090 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.739066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:28.748411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-221bb312-6d94-424b-a3fe-73b5ceebb3db tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1454 microversion: 2.1 time: 0.160090 Jul 28 22:33:28.748979 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 359/712] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:28 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:28.768711 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:28.769424 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:28.776659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.777138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.777944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:28.778384 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:28.915165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:28.923158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cd30b97a-0eba-4ccd-911f-c45cbd33729f tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1454 microversion: 2.1 time: 0.158672 Jul 28 22:33:28.923726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 354/713] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:28 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:29.406829 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:29.407588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:29.414627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:29.415439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:29.416408 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:29.417031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:29.747376 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:29.755741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d446988a-6063-4cce-af73-388d5d82ed27 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1287 microversion: 2.1 time: 0.352879 Jul 28 22:33:29.756321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 360/714] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:29 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1287 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:30.776238 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:30.776861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:30.783641 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:30.784293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:30.785602 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:30.786202 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:30.975044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-6ad7be8f-4dcf-4be0-813d-a489abe54276 req-b7a3049d-68f2-48fd-b9de-0d69787b0c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47525846-7437-4e19-acd2-70f0ea466207", "tag": "ac87f497-4264-4cef-8637-fb0c985ee2c9"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:30.986352 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:31.000222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-62335629-9aa6-4f8a-acab-15768b2dfac4 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.227703 Jul 28 22:33:31.002383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 355/715] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:30 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:31.018468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-6ad7be8f-4dcf-4be0-813d-a489abe54276 req-b7a3049d-68f2-48fd-b9de-0d69787b0c08 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:31.019915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-6ad7be8f-4dcf-4be0-813d-a489abe54276 req-b7a3049d-68f2-48fd-b9de-0d69787b0c08 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:31.033197 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-6ad7be8f-4dcf-4be0-813d-a489abe54276 req-b7a3049d-68f2-48fd-b9de-0d69787b0c08 service nova] Creating event network-changed:ac87f497-4264-4cef-8637-fb0c985ee2c9 for instance 47525846-7437-4e19-acd2-70f0ea466207 on hv-cinder-85093 Jul 28 22:33:31.041085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-6ad7be8f-4dcf-4be0-813d-a489abe54276 req-b7a3049d-68f2-48fd-b9de-0d69787b0c08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070988 Jul 28 22:33:31.042114 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 361/716] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:31.248520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-293d98c7-2d1e-41bb-b954-1981c5a2640d req-22e7dcac-fe22-439f-993e-64fbebfc423e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9e8c61-8952-40e4-86d5-4e525b6c5fb6", "tag": "60c34db1-525c-473a-a014-73ac0c1156d9"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:31.261834 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-293d98c7-2d1e-41bb-b954-1981c5a2640d req-22e7dcac-fe22-439f-993e-64fbebfc423e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:31.262533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-293d98c7-2d1e-41bb-b954-1981c5a2640d req-22e7dcac-fe22-439f-993e-64fbebfc423e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:31.276698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-293d98c7-2d1e-41bb-b954-1981c5a2640d req-22e7dcac-fe22-439f-993e-64fbebfc423e service nova] Creating event network-changed:60c34db1-525c-473a-a014-73ac0c1156d9 for instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 on hv-cinder-85093 Jul 28 22:33:31.283679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-293d98c7-2d1e-41bb-b954-1981c5a2640d req-22e7dcac-fe22-439f-993e-64fbebfc423e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040450 Jul 28 22:33:31.284657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 356/717] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:32.026421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:32.027372 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:32.035973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:32.036661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:32.037998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:32.038473 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:32.182549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:32.190126 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fe46ee4c-cef1-4277-909e-2d5d955b70d5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.170143 Jul 28 22:33:32.190693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 362/718] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:32 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:33.212047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:33.212753 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:33.219526 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:33.219978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:33.220747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:33.221214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:33.358610 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:33.367187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a02e9efc-0ca1-49bb-a41b-03b170b68e99 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.159321 Jul 28 22:33:33.367881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 357/719] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:33 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:34.388402 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:34.389006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:34.396016 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:34.396496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:34.397252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:34.397719 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:34.524252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:34.531736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cb9c5ac9-0cda-4e23-984b-36d7aaac40a5 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.147208 Jul 28 22:33:34.532300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 363/720] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:34 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:35.553721 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:35.554357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:35.560475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:35.560929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:35.561729 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:35.562172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:35.693262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:35.700740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f5424b93-12d2-4329-b0b8-762f31beb066 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.151296 Jul 28 22:33:35.701316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 358/721] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:35 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:36.722122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:36.723362 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:36.729988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:36.730443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:36.731211 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:36.731671 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:36.860327 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:36.868322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bfffa1d8-447c-41ee-a086-a6cff0ea9b45 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.150134 Jul 28 22:33:36.868889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 364/722] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:36 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:37.403469 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-75094c39-deca-466d-807f-596ee9a806a6 req-55ddffa6-5130-46f0-b33c-e9e3fd731665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9e8c61-8952-40e4-86d5-4e525b6c5fb6", "name": "network-vif-plugged", "status": "completed", "tag": "60c34db1-525c-473a-a014-73ac0c1156d9"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:37.414001 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-75094c39-deca-466d-807f-596ee9a806a6 req-55ddffa6-5130-46f0-b33c-e9e3fd731665 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:37.414453 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-75094c39-deca-466d-807f-596ee9a806a6 req-55ddffa6-5130-46f0-b33c-e9e3fd731665 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:37.425377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-75094c39-deca-466d-807f-596ee9a806a6 req-55ddffa6-5130-46f0-b33c-e9e3fd731665 service nova] Creating event network-vif-plugged:60c34db1-525c-473a-a014-73ac0c1156d9 for instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 on hv-cinder-85093 Jul 28 22:33:37.430312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-75094c39-deca-466d-807f-596ee9a806a6 req-55ddffa6-5130-46f0-b33c-e9e3fd731665 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Jul 28 22:33:37.430903 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 359/723] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:37.888321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:37.888898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:37.896120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:37.896570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:37.897337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:37.897800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:38.025543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:38.032956 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8b24dba7-451c-4c7f-91bb-0436f273f439 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.148610 Jul 28 22:33:38.033514 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 365/724] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:37 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:39.051343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:39.056335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:39.057109 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:39.063772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.064230 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.064998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.065441 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.067139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:39.068189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:39.070142 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:39.070792 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=10 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:39.076943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.077393 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.078185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.078621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.201640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:39.205754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lazy-loading 'services' on Instance uuid b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:33:39.209157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-17c241fc-3c01-41c7-809a-65de2c0abd30 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1361 microversion: 2.1 time: 0.158704 Jul 28 22:33:39.209751 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 360/725] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:39 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:39.316188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c18d70ad-1a8d-4fc8-b80f-d5c61c25b217 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments/1e4ada87-179c-44d7-8fb6-be4b33d22a98" status: 202 len: 0 microversion: 2.1 time: 0.252983 Jul 28 22:33:39.316770 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 366/726] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:33:39 2022] DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments/1e4ada87-179c-44d7-8fb6-be4b33d22a98 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 22:33:39.325948 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:39.328076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:39.334087 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.334536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.335293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:39.335728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:39.364102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1ce8127d-016b-4356-9715-ee2ae306826b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042184 Jul 28 22:33:39.365147 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 361/727] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:33:39 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:40.231371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:40.232088 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:40.238541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.238989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.239790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.240219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.370111 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:40.376388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:40.377816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-38913854-b38d-4da5-bc1c-e148fdc8f807 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1548 microversion: 2.1 time: 0.151083 Jul 28 22:33:40.378691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 367/728] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:40 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:40.379072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:40.385978 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.386425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.387187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.387619 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.399267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:40.399752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:40.405556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.406073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.406775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:40.407212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:40.418815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7e4c4636-4333-4399-8d04-940d690d32be tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Jul 28 22:33:40.419849 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 362/729] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:33:40 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:33:40.496401 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-890b71e2-3512-4367-aa64-9c2326864375 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101469 Jul 28 22:33:40.497127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 368/730] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:33:40 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:33:41.433093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:41.435571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:41.443204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.443670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.444448 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.444892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.477098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ca7e8c12-de33-4e5a-bf5b-39ea749efc2f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048457 Jul 28 22:33:41.477990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 369/731] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:33:41 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 22:33:41.483705 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-9fb251c6-ec66-4ca2-906f-8096fce74862 req-6f3018af-f3da-4794-8795-fef42da41685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9e8c61-8952-40e4-86d5-4e525b6c5fb6", "tag": "60c34db1-525c-473a-a014-73ac0c1156d9"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:41.494702 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-9fb251c6-ec66-4ca2-906f-8096fce74862 req-6f3018af-f3da-4794-8795-fef42da41685 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.495217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-9fb251c6-ec66-4ca2-906f-8096fce74862 req-6f3018af-f3da-4794-8795-fef42da41685 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.507956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-9fb251c6-ec66-4ca2-906f-8096fce74862 req-6f3018af-f3da-4794-8795-fef42da41685 service nova] Creating event network-changed:60c34db1-525c-473a-a014-73ac0c1156d9 for instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 on hv-cinder-85093 Jul 28 22:33:41.514379 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-9fb251c6-ec66-4ca2-906f-8096fce74862 req-6f3018af-f3da-4794-8795-fef42da41685 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097742 Jul 28 22:33:41.517749 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 363/732] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:41.557923 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:41.558658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:41.564779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.565312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.566220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.566734 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.593894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:33:41.684644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d765b293-b071-4acc-81a9-f6c9498eed01 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 204 len: 0 microversion: 2.1 time: 0.129740 Jul 28 22:33:41.685670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 370/733] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:33:41 2022] DELETE /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:33:41.695018 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:41.695750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:41.702691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.703144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:41.704109 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:41.704549 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:42.066802 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:42.075138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-10957fa4-a64e-4feb-9b2b-a89da0708856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1690 microversion: 2.1 time: 0.385170 Jul 28 22:33:42.075718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 364/734] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:41 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1690 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:43.097456 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:43.098188 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:43.101423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:43.106807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:43.107260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:43.108031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:43.108470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:43.239238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:43.247295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-253b0c4a-1663-49d4-bef0-833111074317 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1690 microversion: 2.1 time: 0.154051 Jul 28 22:33:43.247871 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 371/735] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:43 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:44.268207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:44.268819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:44.275545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:44.275998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:44.276770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:44.277210 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:44.406955 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:44.415052 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0679fac3-b710-4f38-9261-97f1d6eadf72 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1690 microversion: 2.1 time: 0.150738 Jul 28 22:33:44.415642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 365/736] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:44 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:45.435916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:45.437021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:45.448023 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:45.448584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:45.449396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:45.449877 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:45.582292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:45.590117 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-debb55b9-3531-488a-82b1-b73acb88bf4e tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1690 microversion: 2.1 time: 0.158420 Jul 28 22:33:45.590681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 372/737] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:45 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:46.541925 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:46.543182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:46.550632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.551081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.552114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.552754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.557059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:46.578975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lazy-loading 'flavor' on Instance uuid 8d00f8c1-cefc-4879-afad-88753b55d83f {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:33:46.612388 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:46.613039 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:46.621279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.621279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.635008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.635802 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.641959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:46.701945 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-13cd222c-39de-4cf6-b7d4-06ca87ae9ad9 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "POST /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f/action" status: 202 len: 0 microversion: 2.1 time: 0.163915 Jul 28 22:33:46.703865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 366/738] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:33:46 2022] POST /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:33:46.727546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:46.742697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fbe76de8-c635-4d2a-8ab2-12fe98170e9f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 200 len: 1623 microversion: 2.1 time: 0.134385 Jul 28 22:33:46.757643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 373/739] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:46 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 1623 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:46.757643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:46.757643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:46.758409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.758409 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.758902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.759661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.797898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-656e2fdf-fdbd-4f77-8630-65a5efaf0216 req-8bbf3951-7220-4ecc-a560-e8d35194f497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55a65b2-1c47-4b8b-9298-f7ba3c7acba7", "name": "network-vif-deleted", "tag": "5862132a-b35f-45a3-ac01-bc41c2128bbe"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:46.809658 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-656e2fdf-fdbd-4f77-8630-65a5efaf0216 req-8bbf3951-7220-4ecc-a560-e8d35194f497 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:46.810250 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-656e2fdf-fdbd-4f77-8630-65a5efaf0216 req-8bbf3951-7220-4ecc-a560-e8d35194f497 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:46.824244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-656e2fdf-fdbd-4f77-8630-65a5efaf0216 req-8bbf3951-7220-4ecc-a560-e8d35194f497 service nova] Creating event network-vif-deleted:5862132a-b35f-45a3-ac01-bc41c2128bbe for instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 on hv-cinder-85093 Jul 28 22:33:46.829003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-656e2fdf-fdbd-4f77-8630-65a5efaf0216 req-8bbf3951-7220-4ecc-a560-e8d35194f497 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123300 Jul 28 22:33:46.829845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 367/740] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:46.921914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:46.930030 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-28064cd6-faf5-483d-a0b7-b4fd55bf8f12 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.183842 Jul 28 22:33:46.930591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 374/741] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:46 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:47.772484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:47.773091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: b55a65b2-1c47-4b8b-9298-f7ba3c7acba7] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:47.781373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:47.782166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:47.783332 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:47.783954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:47.804795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] HTTP exception thrown: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Request method failure captured: Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 HTTP/1.1 Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2EPQwi9LUIU2KcR-VvJEOLzgVj_DvzhxqYGxPdqGF3mhyBtTVexK0B28hZ7RtOR_nsdh4svsGv4FiHSMsIi-PlE_OhxfHhTaB3sonqLZllTwI1EjGZRoyaoBkxrxF81nzcBWHie4d1GWaqGLp_Ad_7_8aX77KoIDxcvcPQxDfvMIg Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:33:47.807533 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: afbab63bf079403b8ef652422d581d25 Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. Jul 28 22:33:47.809208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'b55a65b2-1c47-4b8b-9298-f7ba3c7acba7'} Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:33:47.810326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. Jul 28 22:33:47.812567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:33:47.813889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Returning 404 to user: Instance b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:33:47.813889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1f6a59cb-b1b4-494a-8fa1-b815e16b95dd tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7" status: 404 len: 111 microversion: 2.1 time: 0.042160 Jul 28 22:33:47.813889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 368/742] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:47 2022] GET /compute/v2.1/servers/b55a65b2-1c47-4b8b-9298-f7ba3c7acba7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:33:47.819606 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b0a9bb3b-a57a-4488-94a2-4e01d2edda0f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '.version_select at 0x7f743c0f6280>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:47.840384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b0a9bb3b-a57a-4488-94a2-4e01d2edda0f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-371941756" status: 202 len: 0 microversion: 2.1 time: 0.026172 Jul 28 22:33:47.841021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 375/743] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Jul 28 22:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-371941756 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:33:47.952199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:47.952813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:47.959468 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:47.959922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:47.960694 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:47.961132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:48.121377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:48.129145 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8afdd012-a69f-4968-8c56-c21550a29748 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.180653 Jul 28 22:33:48.129746 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 369/744] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:47 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:49.150744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:49.151344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:49.159893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:49.160341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:49.161101 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:49.161565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:49.289988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:49.297415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-04e81d89-577a-450a-b919-3a1c44fdff02 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.151403 Jul 28 22:33:49.298009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 376/745] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:49 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:50.319917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:50.320559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:50.327206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.327657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.328416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.328853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.466421 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:50.474150 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5469bd48-dea8-4f86-9984-c7bb4451208f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.158137 Jul 28 22:33:50.474742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 370/746] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:50 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:50.734786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:50.735277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:50.741867 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.742319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.743073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.743509 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.768739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:33:50.843400 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1cfeaaaf-b9a5-41b9-b1a2-8912bcfed1b2 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 204 len: 0 microversion: 2.1 time: 0.112157 Jul 28 22:33:50.844348 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 377/747] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:33:50 2022] DELETE /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:33:50.852292 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:50.852967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:50.860587 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.861047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.861859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:50.862301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:50.988888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:50.996336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-50f6c842-0214-4eee-b874-73253a29a856 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1507 microversion: 2.1 time: 0.148153 Jul 28 22:33:50.996898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 371/748] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:50 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:51.496518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:51.497220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:51.503359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:51.504066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:51.504826 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:51.505255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:51.638160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:51.645856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e2ac9b9f-5368-4f42-9bc3-2c4864bdbe04 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.153511 Jul 28 22:33:51.646426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 378/749] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:51 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:52.018644 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:52.019279 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:52.027012 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:52.027466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:52.028220 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:52.028653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:52.158706 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:52.166618 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-40e81dde-6a5d-4e4a-895c-0bef2406cf39 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1507 microversion: 2.1 time: 0.151838 Jul 28 22:33:52.167182 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 372/750] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:52 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:52.668395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:52.669000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:52.675480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:52.675927 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:52.676679 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:52.677112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:52.804352 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:52.811803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-20ded39e-9426-4800-a998-684b78daf908 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.147306 Jul 28 22:33:52.812375 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 379/751] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:52 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:53.188172 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:53.188783 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:53.195531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:53.195994 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:53.196770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:53.197209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:53.267168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:53.275611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-320b042b-9888-4f04-8d12-31600c92a418 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 200 len: 1465 microversion: 2.1 time: 0.091281 Jul 28 22:33:53.276574 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 373/752] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:53 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 1465 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:53.333940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-11173c27-8b7d-4523-ac30-812482dc8f78 req-d1eebd28-04e5-4de5-b6cc-206d0e0eaf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20092e58-9863-4f05-95a2-6bb6a42ca0f5", "name": "network-vif-deleted", "tag": "9978da88-5a78-4aab-a326-2ea421a9deb1"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:53.344778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-11173c27-8b7d-4523-ac30-812482dc8f78 req-d1eebd28-04e5-4de5-b6cc-206d0e0eaf74 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:53.345603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-11173c27-8b7d-4523-ac30-812482dc8f78 req-d1eebd28-04e5-4de5-b6cc-206d0e0eaf74 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:53.358471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-11173c27-8b7d-4523-ac30-812482dc8f78 req-d1eebd28-04e5-4de5-b6cc-206d0e0eaf74 service nova] Creating event network-vif-deleted:9978da88-5a78-4aab-a326-2ea421a9deb1 for instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 on hv-cinder-85093 Jul 28 22:33:53.363755 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-11173c27-8b7d-4523-ac30-812482dc8f78 req-d1eebd28-04e5-4de5-b6cc-206d0e0eaf74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033872 Jul 28 22:33:53.364377 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 380/753] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:53.833044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:53.833795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:53.836802 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=56 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:53.842473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:53.842988 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:53.843864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:53.844371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:53.987465 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:53.997326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-da316a63-3ba6-462d-83a4-5d83ae5da5b2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.167925 Jul 28 22:33:53.997926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 374/754] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:53 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:54.298363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:54.299066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 20092e58-9863-4f05-95a2-6bb6a42ca0f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:54.305613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.306071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.306830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.307262 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.320567 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] HTTP exception thrown: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Request method failure captured: Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 HTTP/1.1 Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2EPQwi9LUIU2KcR-VvJEOLzgVj_DvzhxqYGxPdqGF3mhyBtTVexK0B28hZ7RtOR_nsdh4svsGv4FiHSMsIi-PlE_OhxfHhTaB3sonqLZllTwI1EjGZRoyaoBkxrxF81nzcBWHie4d1GWaqGLp_Ad_7_8aX77KoIDxcvcPQxDfvMIg Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:33:54.322229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: afbab63bf079403b8ef652422d581d25 Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. Jul 28 22:33:54.323748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '20092e58-9863-4f05-95a2-6bb6a42ca0f5'} Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:33:54.324687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. Jul 28 22:33:54.326195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:33:54.327575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Returning 404 to user: Instance 20092e58-9863-4f05-95a2-6bb6a42ca0f5 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:33:54.327575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a2f52d4a-df67-422f-ae4a-c2f005775911 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5" status: 404 len: 111 microversion: 2.1 time: 0.029919 Jul 28 22:33:54.327575 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 381/755] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:54 2022] GET /compute/v2.1/servers/20092e58-9863-4f05-95a2-6bb6a42ca0f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:33:54.332261 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:54.332758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:54.340499 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.340949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.341754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.342214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.367669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:33:54.442397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ec3d9692-5b56-4c7c-a71a-81755787048a tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "DELETE /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 204 len: 0 microversion: 2.1 time: 0.113538 Jul 28 22:33:54.443069 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 375/756] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:33:54 2022] DELETE /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:33:54.453212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:54.453856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:54.461483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.461987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.462740 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:54.463174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:54.594711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:54.604774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c4f0a08c-584b-4c06-a1a6-3b6dad47d37f tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.155287 Jul 28 22:33:54.605354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 382/757] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:54 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:55.018516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:55.019246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:55.025764 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.026422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.027350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.027875 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.162173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:55.170505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e68601da-768b-4597-b4e8-2efaab6c6bb1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.156264 Jul 28 22:33:55.171067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 376/758] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:55 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:55.436067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:55.436570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:55.442643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.443092 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.443854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.444289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.466581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e8cab985-99a0-49a5-ab80-0dbd72341c6a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/ips" status: 200 len: 153 microversion: 2.20 time: 0.083175 Jul 28 22:33:55.467112 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 383/759] 10.222.0.39 () {60 vars in 1289 bytes} [Thu Jul 28 22:33:55 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/ips => generated 153 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 22:33:55.625862 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:55.626477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:55.633472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.633961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.634735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:55.635176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:55.786916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:55.795766 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e475b5ac-df53-4e31-8076-34b652449d79 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.174001 Jul 28 22:33:55.796336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 377/760] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:55 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:56.193366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:56.194521 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:56.200919 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:56.201369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:56.202165 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:56.202601 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:56.334468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:56.343159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-36f882c4-1e6e-456e-ac7e-3b260171ecc2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.153719 Jul 28 22:33:56.344176 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 384/761] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:56 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:56.816212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:56.816839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:56.823991 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:56.824428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:56.825180 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:56.825638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:56.952992 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:56.960530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-19056f80-01d7-4b45-a182-9369ae4b0a4b tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.148355 Jul 28 22:33:56.961101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 378/762] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:56 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:57.365788 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:57.366462 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:57.372848 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:57.373306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:57.374128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:57.374571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:57.508532 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:57.516431 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3246f2b4-5a62-47e1-9d90-75a17a7c550f tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.154746 Jul 28 22:33:57.517098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 385/763] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:57 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:57.982240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:57.982861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:57.989439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:57.989922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:57.990695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:57.991181 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.075264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:58.075846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:58.082793 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.083259 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.084244 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.085238 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.110403 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-68f9688e-a43d-4ff8-98f0-1c5fa4606acd tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/ips" status: 200 len: 150 microversion: 2.1 time: 0.105402 Jul 28 22:33:58.110965 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 386/764] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:33:58 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/ips => generated 150 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:58.145583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:58.158211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ff785a57-37b6-41a4-ada7-a74ab0818ad6 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1522 microversion: 2.1 time: 0.179788 Jul 28 22:33:58.158964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 379/765] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:57 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:33:58.391942 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-1b66688b-dc5a-4eac-9d6a-ae9fe3f8d5a6 req-d85d3fac-e21a-4a06-8b27-8bd254e48552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cb74f8-85be-4e53-82a7-ca38fd38cbf5", "name": "network-vif-deleted", "tag": "5fadf80f-a549-46e0-b26a-9fad8d146f17"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:58.406028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1b66688b-dc5a-4eac-9d6a-ae9fe3f8d5a6 req-d85d3fac-e21a-4a06-8b27-8bd254e48552 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.406557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1b66688b-dc5a-4eac-9d6a-ae9fe3f8d5a6 req-d85d3fac-e21a-4a06-8b27-8bd254e48552 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.407287 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:58.407830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:58.418510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.418952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.423428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-1b66688b-dc5a-4eac-9d6a-ae9fe3f8d5a6 req-d85d3fac-e21a-4a06-8b27-8bd254e48552 service nova] Creating event network-vif-deleted:5fadf80f-a549-46e0-b26a-9fad8d146f17 for instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 on hv-cinder-85093 Jul 28 22:33:58.426207 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.427998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.429763 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-1b66688b-dc5a-4eac-9d6a-ae9fe3f8d5a6 req-d85d3fac-e21a-4a06-8b27-8bd254e48552 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040721 Jul 28 22:33:58.434059 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 387/766] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:33:58.457217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:33:58.465732 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lazy-loading 'flavor' on Instance uuid 4c641cce-d011-422d-9a7a-268910d8d1a4 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:33:58.538492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:58.539237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:58.545973 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.546451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.547276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.547717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.646425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8893df02-4485-4054-96ac-1ab8829d9667 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/action" status: 202 len: 0 microversion: 2.20 time: 0.244578 Jul 28 22:33:58.647296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 380/767] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Jul 28 22:33:58 2022] POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 22:33:58.655363 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:58.656043 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:58.662488 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.663461 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.664375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:58.664811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:58.688622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:58.697761 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ed7d9636-6c05-4947-8146-83eee9dc32f4 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.163464 Jul 28 22:33:58.698739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 388/768] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:58 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:58.806981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:58.815079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:58.816605 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:58.817797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-43f613d8-33cd-4f95-ae9a-a72cf2971868 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.166451 Jul 28 22:33:58.818361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 381/769] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:58 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:33:59.180878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:59.181483 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:59.187579 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.188027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.188782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.189218 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.249828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:59.257623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7b441ab5-616b-46ce-8683-b9981d3d19b7 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1306 microversion: 2.1 time: 0.081210 Jul 28 22:33:59.258187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 389/770] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:59 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1306 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:59.517211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9329723-1ac5-4e67-a148-890e2f2a73d9"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:33:59.519663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:59.526692 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.527137 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.527896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.528328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.718614 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:59.719156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:59.725584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.726035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.726790 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.727227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.856828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:33:59.863885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9e113665-4679-4dcd-88f6-800792e5abdc tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.149143 Jul 28 22:33:59.864450 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 390/771] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:33:59 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:33:59.869273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:33:59.869912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:33:59.875562 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.876005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:33:59.876748 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:33:59.877205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:00.013239 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:00.016985 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:00.023518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:00.025073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:00.026287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-25ba295d-7493-4a9a-a5fc-2f4af4419b87 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.160920 Jul 28 22:34:00.026854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 391/772] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:33:59 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:00.278279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:00.278820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:00.286201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:00.286928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:00.287887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:00.288316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:00.324694 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:00.325143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:00.325616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lazy-loading 'fault' on Instance uuid 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:34:00.371296 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbab63bf079403b8ef652422d581d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567bd0fe29da4db5a0f08c8b5cc81f9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:00.379641 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d863383e-ddb1-452e-9c0a-73e76ae682ea tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 200 len: 1311 microversion: 2.1 time: 0.105159 Jul 28 22:34:00.380260 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 392/773] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:00 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:00.409787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b7e8f269-813e-40c7-a9d9-44b46c68305c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896207 Jul 28 22:34:00.410386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 382/774] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:33:59 2022] POST /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:00.885640 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:00.886258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:00.892957 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:00.893499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:00.894413 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:00.894922 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.028905 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:01.038771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-59a6f37a-1962-4048-8141-ab91ae33365b tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.156522 Jul 28 22:34:01.039357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 393/775] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:00 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:01.056274 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:01.057058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:01.063315 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:01.063770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.064563 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:01.065003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.210619 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:01.218707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:01.220234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:01.221398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-709cf57e-ae2f-4ba9-bb8a-cac59782c7c2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.170576 Jul 28 22:34:01.222021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 383/776] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:01 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:01.402167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:01.402822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] [instance: 93cb74f8-85be-4e53-82a7-ca38fd38cbf5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:01.408745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:01.409192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.410009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:01.410445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.425236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] HTTP exception thrown: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Request method failure captured: Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 HTTP/1.1 Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2EPQwi9LUIU2KcR-VvJEOLzgVj_DvzhxqYGxPdqGF3mhyBtTVexK0B28hZ7RtOR_nsdh4svsGv4FiHSMsIi-PlE_OhxfHhTaB3sonqLZllTwI1EjGZRoyaoBkxrxF81nzcBWHie4d1GWaqGLp_Ad_7_8aX77KoIDxcvcPQxDfvMIg Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:34:01.426916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_567bd0fe29da4db5a0f08c8b5cc81f9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 567bd0fe29da4db5a0f08c8b5cc81f9c Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-418322512 Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: afbab63bf079403b8ef652422d581d25 Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-ServerRescueNegativeTestJSON-418322512-project Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. Jul 28 22:34:01.429381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '93cb74f8-85be-4e53-82a7-ca38fd38cbf5'} Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:01.430971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. Jul 28 22:34:01.432442 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:01.433742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] Returning 404 to user: Instance 93cb74f8-85be-4e53-82a7-ca38fd38cbf5 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:01.433742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4ac248fc-be3c-4112-9590-528a79ed66e9 tempest-ServerRescueNegativeTestJSON-418322512 tempest-ServerRescueNegativeTestJSON-418322512-project] 10.222.0.39 "GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5" status: 404 len: 111 microversion: 2.1 time: 0.029988 Jul 28 22:34:01.433742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 394/777] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:01 2022] GET /compute/v2.1/servers/93cb74f8-85be-4e53-82a7-ca38fd38cbf5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:34:01.615498 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-f8d28c68-b2c0-4448-b06e-4ebf97c8ed4e req-afb5e511-b8e3-40ae-969b-8bce3a8a751a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "name": "network-vif-unplugged", "status": "completed", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:01.629869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-f8d28c68-b2c0-4448-b06e-4ebf97c8ed4e req-afb5e511-b8e3-40ae-969b-8bce3a8a751a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:01.630319 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-f8d28c68-b2c0-4448-b06e-4ebf97c8ed4e req-afb5e511-b8e3-40ae-969b-8bce3a8a751a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:01.642497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.compute.server_external_events [req-f8d28c68-b2c0-4448-b06e-4ebf97c8ed4e req-afb5e511-b8e3-40ae-969b-8bce3a8a751a service nova] Unable to find a host for instance 8d00f8c1-cefc-4879-afad-88753b55d83f. Dropping event network-vif-unplugged {{(pid=118085) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 22:34:01.643392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-f8d28c68-b2c0-4448-b06e-4ebf97c8ed4e req-afb5e511-b8e3-40ae-969b-8bce3a8a751a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.101042 Jul 28 22:34:01.644301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 384/778] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 22:34:02.060387 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:02.061127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:02.067834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.068284 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.069098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.069653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.203318 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:02.210836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-95901cf4-e317-409c-99af-f5e03bd8c452 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1509 microversion: 2.1 time: 0.154329 Jul 28 22:34:02.211404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 395/779] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:02 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:02.231880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:02.232477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:02.241204 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.242047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.243461 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.244236 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.246730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:02.247610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:02.254285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.254873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.255750 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.256369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.276653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118085) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 28 22:34:02.368124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f9716642-621a-4f03-a897-7b67befcd565 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "POST /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f/action" status: 202 len: 0 microversion: 2.1 time: 0.140104 Jul 28 22:34:02.368763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 385/780] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:34:02 2022] POST /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:34:02.377822 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:02.378931 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:02.385620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.386067 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.387096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:02.387700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:02.410733 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:02.422111 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:02.424854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:02.426401 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cefe6685-4405-42e4-8b3f-bad551646ccf tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.185786 Jul 28 22:34:02.427323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 396/781] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:02 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:02.535771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:02.544659 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d1d26243-892d-4543-84e8-f327116cff47 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1517 microversion: 2.1 time: 0.170754 Jul 28 22:34:02.557951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 386/782] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:02 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:03.450008 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:03.450802 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:03.457470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:03.458178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:03.459158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:03.460201 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:03.573473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:03.575165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:03.583542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:03.584056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:03.585459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:03.586158 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:03.624212 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:03.635571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:03.638026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:03.640873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-83b28df4-2516-4309-9ab0-7f1d62a55e22 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.193629 Jul 28 22:34:03.658741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 397/783] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:03 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:03.749720 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:03.759687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7140f1aa-9899-4765-9db3-0153f27dbb51 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1519 microversion: 2.1 time: 0.191620 Jul 28 22:34:03.760710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 387/784] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:03 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:04.670484 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:04.672703 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:04.680602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:04.681168 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:04.682383 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:04.682927 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:04.782531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:04.783140 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:04.792704 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:04.797826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:04.799938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:04.807712 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:04.916684 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:04.932700 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:04.934852 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:04.936809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-fc1bd34e-fa0b-4baa-8e5e-0ee36e561250 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.276199 Jul 28 22:34:04.956099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 398/785] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:04 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:04.990313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:05.000422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5c3b0385-94b1-4e75-bf20-229523ac59be tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1519 microversion: 2.1 time: 0.221630 Jul 28 22:34:05.001308 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 388/786] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:04 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:05.964295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:05.964910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:05.971972 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:05.972424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:05.973360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:05.974070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:06.022950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:06.024077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:06.030534 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:06.031335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:06.032032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:06.032582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:06.185783 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:06.194361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:06.195988 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:06.197150 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5a8cc663-0141-4fa1-9f4b-f887d402d2be tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.236788 Jul 28 22:34:06.197918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 399/787] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:05 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:06.214408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:06.222269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0d22a1c1-abb3-46ca-9db9-9d8a2b937702 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1519 microversion: 2.1 time: 0.203824 Jul 28 22:34:06.222838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 389/788] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:06 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:06.310438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-45fa311c-788c-4ff8-bb6b-bebdc52627f3 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Action: 'create', calling method: .version_select at 0x7f743c11dca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-805129274", "metadata": {"Type": "work"}}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-45fa311c-788c-4ff8-bb6b-bebdc52627f3 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 121 Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:34:06.320154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-805129274", "metadata": {"Type": "work"}}} Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: Jul 28 22:34:06.321856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-805129274', 'metadata': {'Type': 'work'}}}} Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise error Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.322846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 22:34:06.324224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 22:34:06.325416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 22:34:06.325416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.325416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-45fa311c-788c-4ff8-bb6b-bebdc52627f3 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.325416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-45fa311c-788c-4ff8-bb6b-bebdc52627f3 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122868 Jul 28 22:34:06.325416 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 400/789] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Jul 28 22:34:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:34:06.331428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c8fe6f50-9da3-4d4a-869a-a8c7b0efeed8 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Action: 'create', calling method: .version_select at 0x7f742ffcb790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1122691687", "metadata": {"Type": "work"}}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c8fe6f50-9da3-4d4a-869a-a8c7b0efeed8 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 120 Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:34:06.336592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1122691687", "metadata": {"Type": "work"}}} Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:34:06.338245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1122691687', 'metadata': {'Type': 'work'}}}} Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise error Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi '0' Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.339226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 22:34:06.340928 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 22:34:06.342530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 22:34:06.342530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.342530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c8fe6f50-9da3-4d4a-869a-a8c7b0efeed8 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.342530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c8fe6f50-9da3-4d4a-869a-a8c7b0efeed8 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010547 Jul 28 22:34:06.342530 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 390/790] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Jul 28 22:34:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:34:06.346796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2fd02fd6-8172-418c-a9bf-cf7274cb74e0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Action: 'create', calling method: .version_select at 0x7f743c01caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726652600", "metadata": {"Type": "work"}}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2fd02fd6-8172-418c-a9bf-cf7274cb74e0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 119 Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:34:06.351153 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726652600", "metadata": {"Type": "work"}}} Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: Jul 28 22:34:06.352729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1726652600', 'metadata': {'Type': 'work'}}}} Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise error Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi '' Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.353838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 22:34:06.355399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 22:34:06.356928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 22:34:06.356928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.356928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2fd02fd6-8172-418c-a9bf-cf7274cb74e0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.356928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2fd02fd6-8172-418c-a9bf-cf7274cb74e0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009402 Jul 28 22:34:06.356928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 401/791] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Jul 28 22:34:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:34:06.361138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2e6aebfd-cadb-4007-9f82-41fad3e503f0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Calling method '.version_select at 0x7f742ffe5c10>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:06.389341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-2e6aebfd-cadb-4007-9f82-41fad3e503f0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] HTTP exception thrown: Volume tempest-invalid-2034946117 could not be found. Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2e6aebfd-cadb-4007-9f82-41fad3e503f0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2034946117 HTTP/1.1 Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:34:06.391411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume tempest-invalid-2034946117 could not be found. Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'tempest-invalid-2034946117'} Jul 28 22:34:06.392896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2034946117 could not be found. (HTTP 404) (Request-ID: req-092efbc3-b95f-43da-90d5-6760a18d4184) Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.394524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:34:06.395958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2034946117 could not be found. Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:34:06.398139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2034946117 could not be found. Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2034946117 could not be found. Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2e6aebfd-cadb-4007-9f82-41fad3e503f0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 404 to user: Volume tempest-invalid-2034946117 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2e6aebfd-cadb-4007-9f82-41fad3e503f0 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2034946117" status: 404 len: 99 microversion: 2.1 time: 0.035338 Jul 28 22:34:06.399573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 391/792] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Jul 28 22:34:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2034946117 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 22:34:06.403794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-de0c4a7a-72b0-4fba-972f-fb07ce90ecf6 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004612 Jul 28 22:34:06.404286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 402/793] 10.222.0.39 () {58 vars in 1140 bytes} [Thu Jul 28 22:34:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 22:34:06.412295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-98dc1215-6568-4961-9cd8-fa3b3ac480fa tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003659 Jul 28 22:34:06.413561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 392/794] 10.222.0.39 () {58 vars in 1137 bytes} [Thu Jul 28 22:34:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 22:34:06.422150 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c733228-80cb-4394-8742-032548a2e66e tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Calling method '.version_select at 0x7f743c01cca0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:06.450235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-9c733228-80cb-4394-8742-032548a2e66e tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] HTTP exception thrown: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c733228-80cb-4394-8742-032548a2e66e tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: DELETE /compute/v2.1/os-volumes/16f8edaf-f603-4420-8c74-af4c52ba27b1 HTTP/1.1 Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:34:06.452613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '16f8edaf-f603-4420-8c74-af4c52ba27b1'} Jul 28 22:34:06.454351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. (HTTP 404) (Request-ID: req-66f4dfeb-034b-4394-b2e2-1717e93d1925) Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.455445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 22:34:06.456898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 22:34:06.458457 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9c733228-80cb-4394-8742-032548a2e66e tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 404 to user: Volume 16f8edaf-f603-4420-8c74-af4c52ba27b1 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9c733228-80cb-4394-8742-032548a2e66e tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/16f8edaf-f603-4420-8c74-af4c52ba27b1" status: 404 len: 109 microversion: 2.1 time: 0.035574 Jul 28 22:34:06.460678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 403/795] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:34:06 2022] DELETE /compute/v2.1/os-volumes/16f8edaf-f603-4420-8c74-af4c52ba27b1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:34:06.464942 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d4b1226e-9bd0-46a1-83ba-7e100557a965 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Calling method '.version_select at 0x7f742ffcb1f0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:06.491913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-d4b1226e-9bd0-46a1-83ba-7e100557a965 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] HTTP exception thrown: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d4b1226e-9bd0-46a1-83ba-7e100557a965 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Request method failure captured: Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/os-volumes/6c8fdcbc-2dea-4128-9272-bfd2bca6166d HTTP/1.1 Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w7eif0a8GtonsfXQztRTnx9sD_4IPBN1aUaTYv0C_OOO3zAPqtd0-7pX9vfrXPFBZ71bPSJIdl4Z8QkDpR53eMcW20Ge-OmMYn-cCDf8dowo4GPZnmt1gVVSb-2fZHT8fgIQ__z_f5dPrbeY9seQenDi6ff5YPm5qTcDZe_2MqbYCA Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:34:06.494224 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f76093ef3ffa4de0a127a3b7de378a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: f76093ef3ffa4de0a127a3b7de378a0f Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesNegativeTest-445385688 Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 59b79255482a4f1b992b6cd764923389 Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesNegativeTest-445385688-project Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '6c8fdcbc-2dea-4128-9272-bfd2bca6166d'} Jul 28 22:34:06.495805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. (HTTP 404) (Request-ID: req-f73b5ec6-707a-4807-9f24-64f99f7e4f33) Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.496735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:34:06.498132 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 22:34:06.500003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d4b1226e-9bd0-46a1-83ba-7e100557a965 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] Returning 404 to user: Volume 6c8fdcbc-2dea-4128-9272-bfd2bca6166d could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d4b1226e-9bd0-46a1-83ba-7e100557a965 tempest-VolumesNegativeTest-445385688 tempest-VolumesNegativeTest-445385688-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6c8fdcbc-2dea-4128-9272-bfd2bca6166d" status: 404 len: 109 microversion: 2.1 time: 0.035196 Jul 28 22:34:06.501373 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 393/796] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:34:06 2022] GET /compute/v2.1/os-volumes/6c8fdcbc-2dea-4128-9272-bfd2bca6166d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:34:07.223054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:07.223838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:07.231834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:07.232287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:07.233057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:07.233493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:07.246195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:07.246962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:07.253190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:07.253877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:07.254878 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:07.255491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:07.447601 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:07.472213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:07.473754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:07.475158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-160d320c-ac87-4b47-bfea-7b4ebca24850 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.257079 Jul 28 22:34:07.480616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:07.488810 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b3d2c9f0-3af2-482a-85a4-6054912ed163 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1519 microversion: 2.1 time: 0.248316 Jul 28 22:34:07.489696 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 394/797] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:07 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:07.489990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 404/798] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:07 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:08.097427 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9329723-1ac5-4e67-a148-890e2f2a73d9"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:08.099922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:08.109934 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.110459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.111306 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.111871 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.200960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: POST /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments HTTP/1.1 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 74 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:34:08.202608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {"volumeAttachment": {"volumeId": "b9329723-1ac5-4e67-a148-890e2f2a73d9"}} Jul 28 22:34:08.204254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'server_id': '02901dd1-28e3-486f-a09c-3af63e2e81f2', 'body': {'volumeAttachment': {'volumeId': 'b9329723-1ac5-4e67-a148-890e2f2a73d9'}}} Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:08.205254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:08.206938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 400 to user: Invalid volume: volume b9329723-1ac5-4e67-a148-890e2f2a73d9 is already attached to instances: 02901dd1-28e3-486f-a09c-3af63e2e81f2 {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-541af532-5df5-4449-9739-d3019315cd1d tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110835 Jul 28 22:34:08.208463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 395/799] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:34:08 2022] POST /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:34:08.275425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:08.275971 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:08.282771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.283379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.284380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.284882 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.367710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'services' on Instance uuid 02901dd1-28e3-486f-a09c-3af63e2e81f2 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:34:08.458824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-695b5ef8-4572-48eb-a22b-59447e516f60 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments/b9329723-1ac5-4e67-a148-890e2f2a73d9" status: 202 len: 0 microversion: 2.1 time: 0.187627 Jul 28 22:34:08.461286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 405/800] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:34:08 2022] DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments/b9329723-1ac5-4e67-a148-890e2f2a73d9 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:34:08.469695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:08.472376 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:08.480054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.480581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.481611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.482121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.509666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:08.515000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:08.516323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b725a6b8-b9de-4464-9ab1-ff6bae034049 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Jul 28 22:34:08.517002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 396/801] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:08 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:34:08.526998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.527394 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.528056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:08.528189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.528655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.528824 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:08.547872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.548327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.549109 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:08.549573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:08.573638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:08.735907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:08.748080 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:08.750339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:08.751523 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2f7890fb-a1c6-4fb4-aee4-9bf88ee740ba tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.251024 Jul 28 22:34:08.752184 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 406/802] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:08 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:08.775285 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:08.782886 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2b02ec66-05b8-47e2-99c4-35972841f775 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.259194 Jul 28 22:34:08.783388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 397/803] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:08 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:09.529002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:09.531337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:09.538621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.539073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.539845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.540292 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.571571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5769601d-b16a-4fe0-8d33-eebaf9100423 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Jul 28 22:34:09.572335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 407/804] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:09 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:09.776179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:09.776725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:09.783171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.783611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.784360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.784791 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.804411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:09.805385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:09.811572 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.812268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.813447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:09.814071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:09.995449 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:09.998945 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:10.003969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:10.005559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:10.007543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-292b1cca-db8b-47b0-af4f-67b69e602777 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.235661 Jul 28 22:34:10.008016 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d8a15bc9-e1cd-4020-821b-a253b729684c tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.207776 Jul 28 22:34:10.008130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 398/805] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:09 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:10.008581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 408/806] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:09 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:10.584003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:10.586378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:10.592506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.592955 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.593748 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.594211 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.623105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3e2705a7-00ca-4550-a5d3-a4d1b2c92976 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043143 Jul 28 22:34:10.623656 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 399/807] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:10 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:34:10.684766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:10.685274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:10.691732 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.692193 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.692958 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.694028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.720043 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:34:10.792660 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-463f71e1-bbc8-4292-bef8-c7ec5ebc6600 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 204 len: 0 microversion: 2.1 time: 0.111423 Jul 28 22:34:10.793240 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 409/808] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:34:10 2022] DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:34:10.802102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:10.804372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:10.811183 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.811629 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.812403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:10.812842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:10.942351 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:10.949728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a90e6ffb-85aa-4b84-847b-67a1d29a9311 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1682 microversion: 2.1 time: 0.152278 Jul 28 22:34:10.950294 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 400/809] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:10 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:11.029490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:11.029893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:11.030268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:11.030494 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:11.036424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.036553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.036877 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:11.036981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:11.038300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.038732 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:11.038828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.039273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:11.058288 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:11.232147 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:11.240200 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:11.241665 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:11.243074 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:11.244253 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-378988e8-bede-4607-90b0-10b2e0d54393 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1746 microversion: 2.20 time: 0.218173 Jul 28 22:34:11.245093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 401/810] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:11 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1746 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:11.249411 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-13b941bf-bf9d-4c32-895a-f9d5117fe9ec tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.224167 Jul 28 22:34:11.250001 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 410/811] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:11 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:11.971938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:11.972630 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:11.979603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.980217 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:11.981084 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:11.981517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:12.112180 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:12.119890 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f464bfa6-702c-411f-874b-3ad19fda3de9 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1682 microversion: 2.1 time: 0.151821 Jul 28 22:34:12.120459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 402/812] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:11 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:12.268060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:12.268587 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:12.270463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:12.271071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:12.275712 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:12.276164 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:12.276929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:12.277361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:12.277627 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:12.278075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:12.278830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:12.279262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:12.472207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:12.477423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:12.481331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:12.482960 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:12.484199 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6b23a384-f296-446f-a947-2a2d57144b0a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1746 microversion: 2.20 time: 0.220164 Jul 28 22:34:12.485406 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 411/813] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:12 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1746 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:12.485974 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-22a0ce02-1f51-40e9-ad44-a1b1e52ec223 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.219314 Jul 28 22:34:12.486535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 403/814] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:12 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:13.144852 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:13.145445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:13.148175 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:13.154520 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.155219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.156317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.158125 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.367241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:13.375934 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a57f926a-06b2-47c1-8bce-f7bcad76032f tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1682 microversion: 2.1 time: 0.237522 Jul 28 22:34:13.377342 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 412/815] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:13 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:13.522277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:13.523693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:13.525106 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:13.529820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:13.544574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.544968 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.545824 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.546964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.547959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.549648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.550570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.553892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.903864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:13.919693 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-335075a1-19b2-449c-a23d-21f255c62b19 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.415425 Jul 28 22:34:13.922341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 404/816] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:13 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:13.949024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-16335822-6c58-440f-a899-f4685b0ca4b6 req-06506937-f757-41cf-8ff0-fc10e9be736e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "name": "network-vif-plugged", "status": "completed", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:13.956931 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:13.968741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:13.970323 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:13.971602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-881bc679-c05c-41aa-b231-ae2c76d95f2d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.462398 Jul 28 22:34:13.972264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 413/817] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:13 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:13.980198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-16335822-6c58-440f-a899-f4685b0ca4b6 req-06506937-f757-41cf-8ff0-fc10e9be736e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:13.980654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-16335822-6c58-440f-a899-f4685b0ca4b6 req-06506937-f757-41cf-8ff0-fc10e9be736e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:13.993977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-16335822-6c58-440f-a899-f4685b0ca4b6 req-06506937-f757-41cf-8ff0-fc10e9be736e service nova] Creating event network-vif-plugged:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:34:13.999476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-16335822-6c58-440f-a899-f4685b0ca4b6 req-06506937-f757-41cf-8ff0-fc10e9be736e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063552 Jul 28 22:34:14.000640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 405/818] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:14.399766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:14.400393 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:14.419702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:14.421438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:14.424143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:14.426891 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:14.434750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-6016f7f2-e281-455d-b3f9-32c39f1b20d3 req-e94ab9a1-a49e-4064-9edf-1aef5a8630ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02901dd1-28e3-486f-a09c-3af63e2e81f2", "name": "network-vif-deleted", "tag": "928ca1a1-5c7c-4967-ac84-b4ef57e684ed"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:14.461147 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-6016f7f2-e281-455d-b3f9-32c39f1b20d3 req-e94ab9a1-a49e-4064-9edf-1aef5a8630ea service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:14.461614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-6016f7f2-e281-455d-b3f9-32c39f1b20d3 req-e94ab9a1-a49e-4064-9edf-1aef5a8630ea service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:14.495524 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-6016f7f2-e281-455d-b3f9-32c39f1b20d3 req-e94ab9a1-a49e-4064-9edf-1aef5a8630ea service nova] Creating event network-vif-deleted:928ca1a1-5c7c-4967-ac84-b4ef57e684ed for instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 on hv-cinder-85093 Jul 28 22:34:14.508780 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-6016f7f2-e281-455d-b3f9-32c39f1b20d3 req-e94ab9a1-a49e-4064-9edf-1aef5a8630ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078408 Jul 28 22:34:14.514571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 406/819] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:34:14.567514 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:14.582977 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f3c73a0c-a545-4616-854c-0b3855e92623 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1614 microversion: 2.1 time: 0.187243 Jul 28 22:34:14.583603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 414/820] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:14 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1614 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:14.945649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:14.946744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:14.958093 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:14.961394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:14.962245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:14.962951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:14.998913 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:14.999635 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:15.012017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:15.012863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:15.014223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:15.014903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:15.259159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:15.281456 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:15.285466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:15.288878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-aba15e5f-4805-4c45-992d-c862b1f1afd6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.294133 Jul 28 22:34:15.292987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 415/821] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:14 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:15.293825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:15.301639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ac29e158-4153-42af-9e40-5cb504d997b8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.361639 Jul 28 22:34:15.303966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 407/822] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:14 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:15.609882 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:15.610500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:15.627893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:15.628886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:15.631129 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:15.634910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:15.705231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:15.705809 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:15.706340 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'fault' on Instance uuid 02901dd1-28e3-486f-a09c-3af63e2e81f2 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:34:15.770231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:15.783207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-011c51bd-8ed3-4b48-b538-bc4396f94485 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 200 len: 1331 microversion: 2.1 time: 0.178409 Jul 28 22:34:15.797555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 416/823] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:15 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:16.319612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:16.320903 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:16.327361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:16.328708 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:16.332230 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.332891 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.333915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.334571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.338929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.339385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.340159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.344892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.575843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:16.587425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:16.588118 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a3da6270-a715-457b-9ef1-62fb04cf49ab tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.263716 Jul 28 22:34:16.601893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:16.602635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:16.604033 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 417/824] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:16 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:16.604313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-477d1b93-a99b-41ba-a619-b4b8321d89e4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.288614 Jul 28 22:34:16.606064 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 408/825] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:16 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:16.811360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:16.812130 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:16.823590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.823966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.824772 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:16.825267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:16.843541 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 HTTP/1.1 Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:34:16.845230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:34:16.846861 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '02901dd1-28e3-486f-a09c-3af63e2e81f2'} Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:34:16.847766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:34:16.849655 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:34:16.851396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:34:16.851396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bf84978b-9c6b-43f4-8723-8b837382eda8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 404 len: 111 microversion: 2.1 time: 0.039649 Jul 28 22:34:16.856475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f109fce2-1be9-4b1d-887b-1cb0ea0e1ebc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '.version_select at 0x7f742ffb3a60>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:16.861689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 418/826] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:16 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:34:16.886754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f109fce2-1be9-4b1d-887b-1cb0ea0e1ebc tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524304912" status: 202 len: 0 microversion: 2.1 time: 0.034594 Jul 28 22:34:16.887705 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 409/827] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Jul 28 22:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524304912 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:34:17.631877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:17.634903 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:17.636724 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:17.638795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:17.654107 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:17.658464 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:17.658929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:17.659743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:17.660183 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:17.663167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:17.663644 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:17.664090 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:17.995459 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:18.012165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:18.013946 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:18.015436 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-930063e5-a349-4e62-b12e-d4fa9df70622 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.390857 Jul 28 22:34:18.016475 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 410/828] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:17 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:18.039725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6ff9e42a-9e4a-4798-8a49-21bb5e628e43 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: .version_select at 0x7f742ffb3af0>, body: {"keypair": {"name": "tempest-keypair-1277343325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSGnmC/DkLEEMKiUZW/zlisWo1kaoROlQo15w1VeJJ6guP1VQgMHtTjsDT8X2dcSGjGvy5n2wmogTtSczJjHNy6yPpohpWCuEb1oVJx50zM1mT+Ad2RzjNJzV1+d/9LnQ=="}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:18.060771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-6ff9e42a-9e4a-4798-8a49-21bb5e628e43 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:34:18.065932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-6ff9e42a-9e4a-4798-8a49-21bb5e628e43 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'key_pairs'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:34:18.078760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:18.095783 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-386b4241-8e5a-4796-b7b6-e3aa31b4acf7 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.470661 Jul 28 22:34:18.106400 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 419/829] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:17 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:18.126097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6ff9e42a-9e4a-4798-8a49-21bb5e628e43 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096601 Jul 28 22:34:18.126877 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 411/830] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:34:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:19.042704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:19.043584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:19.052155 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:19.053641 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:19.054610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:19.055214 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:19.117870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:19.118581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:19.127870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:19.133793 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:19.134927 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:19.136090 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:19.437637 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:19.469266 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:19.485756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:19.487986 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d4db1827-32ed-4d15-b673-2e11ed4340fc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.448781 Jul 28 22:34:19.519046 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 420/831] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:19 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:19.601141 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:19.612708 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-773085c1-f425-475a-a857-fba877049d14 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.499101 Jul 28 22:34:19.614142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 412/832] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:19 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:19.777765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-6a909138-5488-40e5-acf2-1f13a00e41fb req-a57077e8-b6f4-4772-9b6f-6560cf09b650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:19.802010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-6a909138-5488-40e5-acf2-1f13a00e41fb req-a57077e8-b6f4-4772-9b6f-6560cf09b650 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:19.811823 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-6a909138-5488-40e5-acf2-1f13a00e41fb req-a57077e8-b6f4-4772-9b6f-6560cf09b650 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:19.839098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-6a909138-5488-40e5-acf2-1f13a00e41fb req-a57077e8-b6f4-4772-9b6f-6560cf09b650 service nova] Creating event network-vif-plugged:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:34:19.861273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-6a909138-5488-40e5-acf2-1f13a00e41fb req-a57077e8-b6f4-4772-9b6f-6560cf09b650 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092099 Jul 28 22:34:19.862085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 421/833] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:34:20.164265 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1450561717", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ba94cd9-b91a-4088-b65d-e5c882850ab5"}], "security_groups": [{"name": "tempest-securitygroup--868069231"}], "key_name": "tempest-keypair-1277343325", "user_data": "}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:20.322553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] validate_networks() for [('6ba94cd9-b91a-4088-b65d-e5c882850ab5', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:34:20.538728 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:20.549074 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:20.557773 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:20.559086 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:20.559884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:20.560324 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:20.717825 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:20.727885 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:20.729479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:20.730744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-827be66f-0730-491d-8fd2-3e92e6bb4c25 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.199110 Jul 28 22:34:20.742285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 422/834] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:20 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:20.750535 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:20.751341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:20.758913 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:20.759498 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:20.760384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:20.760925 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:21.260229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:21.271316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4d104264-45ac-40e1-81c6-216ca3f358c2 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1575 microversion: 2.1 time: 0.538346 Jul 28 22:34:21.272349 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 423/835] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:20 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1575 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:21.300032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:34:21.301424 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:34:21.302021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:34:21.304098 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:34:21.305003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:34:21.315781 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:21.316519 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:21.317568 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:21.319575 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:21.336268 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:21.343110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:34:21.350608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Getting quotas for user d38b517910894f7fa4351a2120b466d7 and project d0c7b146e08f4a9ea11f1a73099eb7ea. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:34:21.372380 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:34:21.375243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:34:21.451952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0a830740-69a4-4be6-b78a-0b9253b94cd0 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.292921 Jul 28 22:34:21.452604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 413/836] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:34:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:34:21.464158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f3b613f-c0b7-4fa7-90a4-80e734d5d164 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:21.464970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5f3b613f-c0b7-4fa7-90a4-80e734d5d164 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:21.524384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f3b613f-c0b7-4fa7-90a4-80e734d5d164 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:21.534593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5f3b613f-c0b7-4fa7-90a4-80e734d5d164 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1242 microversion: 2.1 time: 0.074303 Jul 28 22:34:21.548074 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 424/837] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:21 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:21.761640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:21.765899 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:21.798091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:21.811502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:21.812943 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:21.813634 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:22.094347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:22.107484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:22.110813 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:22.112410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cd31760f-a70c-4082-8786-83e5d9285df0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.359272 Jul 28 22:34:22.113538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 414/838] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:21 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:22.294459 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:22.294459 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:22.302425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:22.302890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:22.303722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:22.304099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:22.497722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:22.508615 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-afe43859-ec50-489c-9b2e-d12500380bd1 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1562 microversion: 2.1 time: 0.219386 Jul 28 22:34:22.509315 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 425/839] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:22 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:22.556579 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:22.557185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:22.564173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:22.564964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:22.565971 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:22.566583 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:22.653619 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:22.663651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d8a4538d-63b0-4d1f-a64c-7aaadcca9d4c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1294 microversion: 2.1 time: 0.111734 Jul 28 22:34:22.678389 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 415/840] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:22 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:23.138291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:23.139879 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:23.151987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:23.152800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:23.153757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:23.154436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:23.326769 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:23.336493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:23.338277 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:23.339583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-544c0533-4d2a-4686-a9f6-555ee0c16eef tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.206976 Jul 28 22:34:23.356593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 426/841] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:23 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:23.686089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:23.686789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:23.696888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:23.697620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:23.698587 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:23.699003 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:23.771725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:23.780444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-afd994b7-d049-4bd0-8b86-4e8163fd1aea tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1300 microversion: 2.1 time: 0.098735 Jul 28 22:34:23.796177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 416/842] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:23 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:24.364332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:24.365435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:24.376571 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:24.378033 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:24.380487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:24.382797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:24.609128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:24.620055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:24.621620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:24.631627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6fee6d9b-5d20-4fe1-af90-5117d43603d2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.271060 Jul 28 22:34:24.632593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 427/843] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:24 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:24.812948 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:24.814489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:24.848440 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:24.852216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:24.857932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:24.859247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:25.067300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:25.076355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-545e8038-08bd-440a-9bdf-f68477ec5885 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.276970 Jul 28 22:34:25.090740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 417/844] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:24 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:25.164013 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-c897f867-d0f7-4b21-9738-38b111438efa req-c544fce1-29da-4de7-ae6f-100aa61ea35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c132dc-7c92-4660-afaa-1dd24ffa061f", "tag": "331a5f1a-4b53-4977-9650-7b036b77770c"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:25.176622 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-c897f867-d0f7-4b21-9738-38b111438efa req-c544fce1-29da-4de7-ae6f-100aa61ea35d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:25.193562 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-c897f867-d0f7-4b21-9738-38b111438efa req-c544fce1-29da-4de7-ae6f-100aa61ea35d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:25.228647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-c897f867-d0f7-4b21-9738-38b111438efa req-c544fce1-29da-4de7-ae6f-100aa61ea35d service nova] Creating event network-changed:331a5f1a-4b53-4977-9650-7b036b77770c for instance 63c132dc-7c92-4660-afaa-1dd24ffa061f on hv-cinder-85093 Jul 28 22:34:25.250309 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-c897f867-d0f7-4b21-9738-38b111438efa req-c544fce1-29da-4de7-ae6f-100aa61ea35d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090381 Jul 28 22:34:25.254511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 428/845] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:25.657814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:25.658623 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:25.666624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:25.668316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:25.669247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:25.689939 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:25.689939 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:25.854142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:25.866643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:25.868770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:25.870065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ad289499-2999-4949-a6e1-732b37ec12f5 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.216226 Jul 28 22:34:25.887220 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 418/846] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:25 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:26.102818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:26.104079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:26.111688 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:26.112145 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:26.112983 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:26.113499 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:26.268584 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:26.272704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:26.278360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-61ca9045-010c-47d6-b0c5-c60f385c454c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.180530 Jul 28 22:34:26.279024 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 429/847] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:26 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:26.905507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:26.906160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:26.913060 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:26.913506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:26.914296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:26.914729 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:27.054816 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:27.063658 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:27.065244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:27.066437 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1b95793f-5fc4-439f-bcf1-1da6f19fb6cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1741 microversion: 2.20 time: 0.165309 Jul 28 22:34:27.066998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 419/848] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:26 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:27.300544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:27.301239 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:27.310223 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:27.311092 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:27.311870 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:27.312306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:27.448786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:27.457287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-82fdeb34-b488-4cb9-8e41-2f1aa0173159 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.160848 Jul 28 22:34:27.463745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 430/849] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:27 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:27.963565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:27.964062 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:27.971639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:27.972460 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:27.972845 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:27.973283 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:27.998386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-09093d68-d232-487a-8b1d-4cbb5a65d415 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/ips" status: 200 len: 147 microversion: 2.1 time: 0.038610 Jul 28 22:34:27.998979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 420/850] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:34:27 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:28.090981 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:28.091791 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:28.098589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:28.100151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:28.101137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:28.101794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:28.261217 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:28.270189 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:28.273316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:28.274912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b38586fc-ba3a-49a0-893a-bd8a271a55c3 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1723 microversion: 2.20 time: 0.188022 Jul 28 22:34:28.275537 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 431/851] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:28 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:28.479191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:28.479882 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:28.486383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:28.486834 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:28.487601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:28.488032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:28.631353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:28.640183 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e10f500b-81ac-4307-8c6c-72c864325557 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.164863 Jul 28 22:34:28.641049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 421/852] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:28 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:29.299379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:29.299985 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:29.306978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.307423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.308220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.308654 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.410760 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8819b458-edee-4d58-9fe1-f62c1355fafd"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:29.413670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:29.419818 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.420453 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.421364 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.421822 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.456421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:29.465187 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:29.466814 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:29.468043 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c3fc11c3-ed05-4281-b0b6-d6bf7c15d14a tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1723 microversion: 2.20 time: 0.172527 Jul 28 22:34:29.469836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 432/853] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:29 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:29.662380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:29.663091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:29.669078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.669548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.670515 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.670974 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.860690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:29.872157 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-476532a6-ee73-4658-8457-a4746ee6e49a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.214554 Jul 28 22:34:29.873257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 433/854] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:29 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:29.887640 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-cbf4944e-a893-431d-bca3-d36c8aecad5e req-1321a801-d9f9-481e-9847-f4d2a7d3fefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c132dc-7c92-4660-afaa-1dd24ffa061f", "name": "network-vif-plugged", "status": "completed", "tag": "331a5f1a-4b53-4977-9650-7b036b77770c"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:29.906194 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-cbf4944e-a893-431d-bca3-d36c8aecad5e req-1321a801-d9f9-481e-9847-f4d2a7d3fefa service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:29.909014 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-cbf4944e-a893-431d-bca3-d36c8aecad5e req-1321a801-d9f9-481e-9847-f4d2a7d3fefa service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:29.944048 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-cbf4944e-a893-431d-bca3-d36c8aecad5e req-1321a801-d9f9-481e-9847-f4d2a7d3fefa service nova] Creating event network-vif-plugged:331a5f1a-4b53-4977-9650-7b036b77770c for instance 63c132dc-7c92-4660-afaa-1dd24ffa061f on hv-cinder-85093 Jul 28 22:34:29.951539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-cbf4944e-a893-431d-bca3-d36c8aecad5e req-1321a801-d9f9-481e-9847-f4d2a7d3fefa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074253 Jul 28 22:34:29.952690 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 434/855] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:29.991998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-461e0705-76e5-4b6d-bd39-23dbc3d5e4af tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584475 Jul 28 22:34:29.993383 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 422/856] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:34:29 2022] POST /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:30.492880 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:30.493642 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:30.499795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.500244 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.501010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.501453 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.640485 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:30.649593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:30.651105 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:30.652254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1590c904-899a-4780-9e04-c0fc30fa22d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1666 microversion: 2.20 time: 0.164968 Jul 28 22:34:30.652813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 435/857] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:30 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:30.675416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a86a8c1-4c6a-481c-bedf-ca47a34f5876"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:30.678091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:30.684804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.685259 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.686079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.686523 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.895573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:30.896471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:30.903855 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.904304 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.905071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:30.905625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:30.981691 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c40159c2-d513-4e2a-abfa-cda0e692860d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310784 Jul 28 22:34:30.982772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 423/858] 10.222.0.39 () {62 vars in 1364 bytes} [Thu Jul 28 22:34:30 2022] POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 22:34:31.044479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:31.053987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-12a44f5e-6ed6-4500-9ce8-5594d06c2d69 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.162369 Jul 28 22:34:31.055423 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 436/859] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:30 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:31.118984 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:31.119541 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:31.125606 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.126053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.126807 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.127269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.330538 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:31.365775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=10 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:31.523755 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-157a10d9-a898-4f85-87ce-6daa4a5a43d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments/2a86a8c1-4c6a-481c-bedf-ca47a34f5876" status: 202 len: 0 microversion: 2.20 time: 0.408456 Jul 28 22:34:31.524520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 424/860] 10.222.0.39 () {60 vars in 1457 bytes} [Thu Jul 28 22:34:31 2022] DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments/2a86a8c1-4c6a-481c-bedf-ca47a34f5876 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:34:31.587334 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:31.587909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:31.590380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:31.596143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.596588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.597360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.597816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.642741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118086) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 28 22:34:31.712647 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-115f515d-db5c-47be-8421-6d9b1409c45d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/action" status: 202 len: 0 microversion: 2.20 time: 0.129275 Jul 28 22:34:31.713293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 437/861] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Jul 28 22:34:31 2022] POST /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:34:31.721772 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:31.722613 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:31.729817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.730347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.731195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.731883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.875263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:31.885450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:31.888051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:31.893487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f85f053d-171f-40b2-ba93-a1cae92309cc tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1674 microversion: 2.20 time: 0.175616 Jul 28 22:34:31.894339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 425/862] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:31 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:31.970288 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-bbe335b4-d292-4ff4-a3bb-5f7f79f4f492 req-a591a29f-bc34-469c-997d-88f5e09024a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "name": "network-vif-unplugged", "status": "completed", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:31.980142 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bbe335b4-d292-4ff4-a3bb-5f7f79f4f492 req-a591a29f-bc34-469c-997d-88f5e09024a9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:31.980702 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-bbe335b4-d292-4ff4-a3bb-5f7f79f4f492 req-a591a29f-bc34-469c-997d-88f5e09024a9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:31.992617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.compute.server_external_events [req-bbe335b4-d292-4ff4-a3bb-5f7f79f4f492 req-a591a29f-bc34-469c-997d-88f5e09024a9 service nova] Unable to find a host for instance 4c641cce-d011-422d-9a7a-268910d8d1a4. Dropping event network-vif-unplugged {{(pid=118086) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 22:34:31.993549 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-bbe335b4-d292-4ff4-a3bb-5f7f79f4f492 req-a591a29f-bc34-469c-997d-88f5e09024a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027275 Jul 28 22:34:31.994182 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 438/863] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 22:34:32.076186 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:32.076814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:32.082998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:32.084070 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:32.085713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:32.086426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:32.294531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:32.304851 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8cbc4f08-a9b4-4d8c-8aab-19c86c6c2374 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1367 microversion: 2.1 time: 0.232537 Jul 28 22:34:32.305734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 426/864] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:32 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:32.920253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:32.920886 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:32.930079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:32.930522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:32.931295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:32.931727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:33.076300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:33.089478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:33.091088 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:33.092270 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1cfae80c-a106-458e-8cf3-7aa93dacbea7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.175985 Jul 28 22:34:33.092823 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 439/865] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:32 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:33.327542 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:33.328080 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:33.336935 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:33.337393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:33.338212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:33.338653 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:33.478277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:33.485842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d634c1b0-997b-45d0-8c39-968657700198 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1558 microversion: 2.1 time: 0.162526 Jul 28 22:34:33.486409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 427/866] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:33 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:33.507492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:33.507989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:33.514095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:33.514550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:33.515317 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:33.515756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:33.595773 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-da72dc38-a382-4670-9189-fff9af43bfe8 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092998 Jul 28 22:34:33.596373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 440/867] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Jul 28 22:34:33 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:34.121686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:34.123002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:34.134393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:34.135445 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:34.136816 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:34.137869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:34.457925 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:34.462304 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=6 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:34.471063 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:34.472955 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:34.474523 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9b8059cc-3675-43d9-9fba-634440f3f5ae tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.362387 Jul 28 22:34:34.475413 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 428/868] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:34 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:34.951869 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-a2423ea6-c490-441c-9a4e-f2b67ea5efb5 req-b684dc3b-adb8-48bd-99d1-f355d547537a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c132dc-7c92-4660-afaa-1dd24ffa061f", "tag": "331a5f1a-4b53-4977-9650-7b036b77770c"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:34.962716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-a2423ea6-c490-441c-9a4e-f2b67ea5efb5 req-b684dc3b-adb8-48bd-99d1-f355d547537a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:34.963512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-a2423ea6-c490-441c-9a4e-f2b67ea5efb5 req-b684dc3b-adb8-48bd-99d1-f355d547537a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:34.980460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-a2423ea6-c490-441c-9a4e-f2b67ea5efb5 req-b684dc3b-adb8-48bd-99d1-f355d547537a service nova] Creating event network-changed:331a5f1a-4b53-4977-9650-7b036b77770c for instance 63c132dc-7c92-4660-afaa-1dd24ffa061f on hv-cinder-85093 Jul 28 22:34:34.985569 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-a2423ea6-c490-441c-9a4e-f2b67ea5efb5 req-b684dc3b-adb8-48bd-99d1-f355d547537a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038024 Jul 28 22:34:34.986707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 441/869] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:35.503425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:35.504066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:35.513171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:35.513662 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:35.514438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:35.514873 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:35.677153 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:35.688218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:35.690185 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:35.691598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-aa8769fe-5680-4b4f-9091-c8ddd65cfd44 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.197656 Jul 28 22:34:35.692688 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 429/870] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:35 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:36.719447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:36.720139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:36.727526 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:36.728242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:36.729049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:36.729490 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:36.880941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:36.889404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:36.891467 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:36.892787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9e4ed116-cebe-4d44-82b0-b49832634e33 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.178281 Jul 28 22:34:36.893454 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 442/871] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:36 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:37.917589 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:37.918274 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:37.925837 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:37.927101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:37.928051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:37.928669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:38.088603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:38.096964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:38.098689 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:38.099953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8c5edf1b-c5d6-4b40-94a3-6f409104995d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.186545 Jul 28 22:34:38.100509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 430/872] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:37 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:39.123990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:39.125496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:39.134961 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:39.135803 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:39.136830 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:39.137493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:39.281759 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:39.291160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:39.292716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:39.293911 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2c00c766-9c78-48fb-8773-e09a5ad2eac4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.174469 Jul 28 22:34:39.294680 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 443/873] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:39 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:40.320961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:40.322101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:40.330710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:40.331152 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:40.331920 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:40.332347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:40.473059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:40.483797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:40.485307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:40.486540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-15212dae-9ab9-4737-9ba9-425b255831f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.173654 Jul 28 22:34:40.487105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 431/874] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:40 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:41.510554 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:41.511186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:41.517887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:41.518351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:41.519116 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:41.519561 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:41.656049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:41.665643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:41.667207 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:41.668883 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-abcba9df-8fe0-444c-9f55-ecf3d8c885d9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.162832 Jul 28 22:34:41.675299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 444/875] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:41 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:42.695704 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:42.697102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:42.705500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:42.706058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:42.706897 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:42.707402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:42.855851 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:42.864013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:42.866916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:42.867758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ecf87517-dae5-4b1e-a61e-9c1e777a8dc8 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.177566 Jul 28 22:34:42.868318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 432/876] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:42 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:43.895067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:43.895744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:43.899215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:43.905698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:43.906152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:43.906915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:43.907354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:44.037255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:44.045307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:44.046842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:44.047984 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-87c063db-0464-4453-be65-7e286673255e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.156933 Jul 28 22:34:44.048542 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 445/877] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:43 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:45.072321 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:45.072924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:45.079406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:45.079852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:45.080608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:45.081038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:45.214757 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:45.222676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:45.224175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:45.226248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0b6b9326-4172-4c5c-b97b-ca7ce7b1477b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.157794 Jul 28 22:34:45.226801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 433/878] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:45 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:46.181496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:46.183635 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:46.190033 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.190478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.191230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.191661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.222367 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bbe60925-84df-49b9-aa32-b8b1a086b81f tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Jul 28 22:34:46.222917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 446/879] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:46 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:46.234017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:46.234514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:46.241865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.242312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.243077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.243516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.248095 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:46.248711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:46.254992 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.255455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.256404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:46.256851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:46.272409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a333df31-7cbd-44f6-94b9-6c9d0a4a601b tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd" status: 200 len: 194 microversion: 2.1 time: 0.042218 Jul 28 22:34:46.273002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 434/880] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Jul 28 22:34:46 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:46.392005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:46.395658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:46.401767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:46.403486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:46.404656 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0dcd958b-fa73-4007-99b4-d71162a454b6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.160425 Jul 28 22:34:46.405215 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 447/881] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:46 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:47.429119 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:47.429850 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:47.436639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:47.437242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:47.438201 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:47.438730 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:47.572593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:47.580563 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:47.582089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:47.583235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0bc94515-02e8-4861-bc86-4ab8ce80c96d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.158824 Jul 28 22:34:47.584325 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 435/882] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:47 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:47.623304 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0793ed66-e5f2-402d-8776-32b53c77f98e"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:47.625594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:47.634021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:47.634468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:47.635229 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:47.635661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:47.879389 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4c5aba4d-27fa-4651-8f0c-0f7325f93f3a tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "POST /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260610 Jul 28 22:34:47.880167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 448/883] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:34:47 2022] POST /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:48.606750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:48.607291 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:48.613698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:48.614129 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:48.615429 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:48.616150 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:48.758669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:48.766909 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:48.768340 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:48.769511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8453acba-028e-46eb-9fe4-476b94c17ddb tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.166726 Jul 28 22:34:48.770090 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 436/884] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:48 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:49.794350 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:49.795792 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:49.804739 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:49.805606 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:49.806662 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:49.807087 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-c3d11646-a46c-4870-925a-4b1a5f1026f3 req-76c68197-54af-4ade-b829-4c1aa195f2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "name": "network-vif-plugged", "status": "completed", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:49.807838 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:49.836466 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c3d11646-a46c-4870-925a-4b1a5f1026f3 req-76c68197-54af-4ade-b829-4c1aa195f2e5 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:49.839086 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-c3d11646-a46c-4870-925a-4b1a5f1026f3 req-76c68197-54af-4ade-b829-4c1aa195f2e5 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:49.866066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-c3d11646-a46c-4870-925a-4b1a5f1026f3 req-76c68197-54af-4ade-b829-4c1aa195f2e5 service nova] Creating event network-vif-plugged:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:34:49.884328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-c3d11646-a46c-4870-925a-4b1a5f1026f3 req-76c68197-54af-4ade-b829-4c1aa195f2e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084419 Jul 28 22:34:49.890645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 437/885] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:49.997828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:50.017285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:50.019617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:50.021686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6a725a1c-d7af-4d0c-8fe6-db32cdebdad7 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.232827 Jul 28 22:34:50.039159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 449/886] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:49 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:51.048997 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:51.049728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:51.056176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:51.056624 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:51.057382 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:51.057849 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:51.188631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:51.196997 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:51.198528 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:51.199672 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c2b4e0f6-47d2-4ac4-9697-7f84a02380f9 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.155588 Jul 28 22:34:51.200226 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 438/887] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:51 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:52.006619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1339770779", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "networks": [{"uuid": "0ffc9792-b9bf-47d9-8c02-0f7cb45eec99"}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:52.060003 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] validate_networks() for [('0ffc9792-b9bf-47d9-8c02-0f7cb45eec99', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:34:52.223228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:52.225095 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:52.227805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:52.233646 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:52.234118 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:52.234904 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:52.235341 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:52.495352 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:52.507596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:52.509112 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:52.510901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9c16310d-9367-422c-9da8-323d17e3f69b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1732 microversion: 2.20 time: 0.291278 Jul 28 22:34:52.510901 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 439/888] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:52 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:34:52.531673 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:34:52.532094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:34:52.532560 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:34:52.532978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:34:52.533394 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:34:52.543044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:52.543488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:52.544285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:52.544721 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:52.561422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Getting quotas for project f5144f6ac53848fe84bdcb15e5242f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:34:52.565399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Getting quotas for user d649218b6ae047c480de9640727aaded and project f5144f6ac53848fe84bdcb15e5242f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:34:52.576513 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:34:52.578821 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:34:52.622835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5bdd05c1-7284-44f7-86b0-da77900bc846 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621071 Jul 28 22:34:52.623663 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 450/889] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:34:52.634598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c81fe886-28da-4bc6-a8bd-b950fa1b3722 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:52.635391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c81fe886-28da-4bc6-a8bd-b950fa1b3722 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:52.692749 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c81fe886-28da-4bc6-a8bd-b950fa1b3722 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:52.699740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c81fe886-28da-4bc6-a8bd-b950fa1b3722 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1214 microversion: 2.1 time: 0.069175 Jul 28 22:34:52.700311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 440/890] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:52 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:53.534435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:53.534958 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:53.541906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:53.542359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:53.543156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:53.543599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:53.682811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:53.690978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:53.692496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:53.693728 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b35cfe72-ae8c-49db-beab-384761eb6c81 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1719 microversion: 2.20 time: 0.163802 Jul 28 22:34:53.694289 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 451/891] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:34:53 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:34:53.720703 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:53.721310 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:53.728892 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:53.729342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:53.730139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:53.730582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:53.792432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:53.799900 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-98129b76-9aff-489e-97c2-d1df5b22a567 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1274 microversion: 2.1 time: 0.083109 Jul 28 22:34:53.800462 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 441/892] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:53 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:54.823034 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:54.823687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:54.842051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:54.842962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:54.846514 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:54.847521 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:54.935436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:54.943858 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c1108f34-6b43-4198-8ae9-73576792392a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1272 microversion: 2.1 time: 0.126188 Jul 28 22:34:54.944529 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 452/893] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:54 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:55.455306 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:55.457484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:55.463893 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.464339 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.465106 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.465553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.496636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-19f2cedc-1663-4a80-b530-c532a149aa04 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045265 Jul 28 22:34:55.497379 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 442/894] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:55 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:55.638876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:55.639360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:55.645319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.646330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.647685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.648128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.680122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-393622ad-7be7-4e18-a7fa-e26b2dc00196 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd" status: 200 len: 194 microversion: 2.1 time: 0.045356 Jul 28 22:34:55.680717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 453/895] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Jul 28 22:34:55 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:55.690961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:55.691457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:55.698036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.698564 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.699342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.699784 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.782967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lazy-loading 'services' on Instance uuid 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:34:55.808921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-03c569b4-6f04-4b57-9e2b-53fbcaf3f3d6 req-37423ba7-31a6-4644-b69e-ebb100fc870d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0d4bc8-8ab6-4173-9444-bd1af30c7b27", "tag": "916808d8-9c55-4a8a-8cc1-d5309bf50c19"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:34:55.823741 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-03c569b4-6f04-4b57-9e2b-53fbcaf3f3d6 req-37423ba7-31a6-4644-b69e-ebb100fc870d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.824357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-03c569b4-6f04-4b57-9e2b-53fbcaf3f3d6 req-37423ba7-31a6-4644-b69e-ebb100fc870d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.846244 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-03c569b4-6f04-4b57-9e2b-53fbcaf3f3d6 req-37423ba7-31a6-4644-b69e-ebb100fc870d service nova] Creating event network-changed:916808d8-9c55-4a8a-8cc1-d5309bf50c19 for instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 on hv-cinder-85093 Jul 28 22:34:55.852692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-03c569b4-6f04-4b57-9e2b-53fbcaf3f3d6 req-37423ba7-31a6-4644-b69e-ebb100fc870d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052864 Jul 28 22:34:55.853371 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 454/896] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:34:55.872022 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-02615969-0f2b-468d-a7d5-3a7a19c17e08 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd" status: 202 len: 0 microversion: 2.1 time: 0.184783 Jul 28 22:34:55.872960 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 443/897] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:34:55 2022] DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/8819b458-edee-4d58-9fe1-f62c1355fafd => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:34:55.965509 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:55.966232 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:55.972668 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.973120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:55.974735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:55.974895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:56.103313 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:56.110844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3c50a933-b3d5-4164-bea0-296da780ce72 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.149506 Jul 28 22:34:56.111408 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 455/898] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:55 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:34:57.010566 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:57.011139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:57.017391 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.017866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.018655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.019085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.048761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8010f57e-05c9-4d68-9fb5-01dd39906423 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/0793ed66-e5f2-402d-8776-32b53c77f98e" status: 200 len: 194 microversion: 2.1 time: 0.043549 Jul 28 22:34:57.049331 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 444/899] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Jul 28 22:34:57 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/0793ed66-e5f2-402d-8776-32b53c77f98e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:34:57.060062 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:57.060593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:57.067239 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.068708 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.069488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.069959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.132361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:57.133020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:57.138965 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.139412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.140164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:57.140596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:57.151816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lazy-loading 'services' on Instance uuid 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:34:57.224939 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-666403f2-7058-4b14-9efa-4c4698e1d3e3 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/0793ed66-e5f2-402d-8776-32b53c77f98e" status: 202 len: 0 microversion: 2.1 time: 0.168630 Jul 28 22:34:57.225623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 456/900] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:34:57 2022] DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments/0793ed66-e5f2-402d-8776-32b53c77f98e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:34:57.278900 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:57.286990 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-66de82bb-5957-4869-9f5d-d02f66d309e9 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.158709 Jul 28 22:34:57.287546 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 445/901] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:57 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:58.309961 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:58.310697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:58.316943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:58.317395 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:58.318810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:58.319253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:58.452694 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:58.460504 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-455169d2-5694-4778-83bf-eebd1009ac00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.155691 Jul 28 22:34:58.461183 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 457/902] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:58 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:59.456491 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:59.459062 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:59.465778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.466234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.467002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.467444 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.481103 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:59.481734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:34:59.481862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:59.488120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.488623 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.489836 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.490534 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.499472 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cd33a050-dbd5-4256-bb60-7978d51b48f8 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046907 Jul 28 22:34:59.500046 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 446/903] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:59 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:34:59.613560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:59.616342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:59.622431 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.622888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.623662 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.624099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.624286 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:59.632630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5f8476d0-7cba-4c58-895a-fe49f6c695ae tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.155293 Jul 28 22:34:59.633195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 458/904] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:59 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:34:59.653330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2fba2d74-d1de-412d-b148-d9d68d2b6eee tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043799 Jul 28 22:34:59.653944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 447/905] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:34:59 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 22:34:59.715167 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:59.715667 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:59.721631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.722080 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.722834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.723270 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.748653 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:34:59.825405 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3ca14a05-c5cb-4689-b699-04c1263e7103 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 204 len: 0 microversion: 2.1 time: 0.113680 Jul 28 22:34:59.826122 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 459/906] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:34:59 2022] DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:34:59.834406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:34:59.835056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:34:59.840998 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.841550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.842333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:34:59.842767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:34:59.981374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:34:59.988866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b391f953-b21e-4c67-86dc-c4be5b6f3522 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1673 microversion: 2.1 time: 0.158403 Jul 28 22:34:59.990640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 448/907] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:34:59 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:00.655589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:00.656291 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:00.662930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:00.663369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:00.664121 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:00.664553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:00.795685 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:00.803612 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-74363a2c-2949-4967-b918-83c527a9ed0c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.152298 Jul 28 22:35:00.804176 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 460/908] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:00 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:01.012707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:01.013271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:01.019808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:01.020266 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:01.021241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:01.021725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:01.148892 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:01.157002 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5dd79161-b29a-4ed7-8fed-80a606e2fb56 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1673 microversion: 2.1 time: 0.147889 Jul 28 22:35:01.157162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 449/909] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:01 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:01.824195 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:01.824947 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:01.831494 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:01.831953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:01.832727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:01.833841 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:01.868231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-eb942771-3694-4a2f-bed7-39ff6b4a7593 req-58fdf1fb-ab26-486e-9c88-65e3a460be6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0d4bc8-8ab6-4173-9444-bd1af30c7b27", "name": "network-vif-plugged", "status": "completed", "tag": "916808d8-9c55-4a8a-8cc1-d5309bf50c19"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:01.882163 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-eb942771-3694-4a2f-bed7-39ff6b4a7593 req-58fdf1fb-ab26-486e-9c88-65e3a460be6d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:01.882604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-eb942771-3694-4a2f-bed7-39ff6b4a7593 req-58fdf1fb-ab26-486e-9c88-65e3a460be6d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:01.894501 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-eb942771-3694-4a2f-bed7-39ff6b4a7593 req-58fdf1fb-ab26-486e-9c88-65e3a460be6d service nova] Creating event network-vif-plugged:916808d8-9c55-4a8a-8cc1-d5309bf50c19 for instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 on hv-cinder-85093 Jul 28 22:35:01.900989 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-eb942771-3694-4a2f-bed7-39ff6b4a7593 req-58fdf1fb-ab26-486e-9c88-65e3a460be6d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036380 Jul 28 22:35:01.902143 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 450/910] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:01.989810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:01.999675 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9caf9a90-521d-4442-9143-6f2d78771c4f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.178975 Jul 28 22:35:02.001267 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 461/911] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:01 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:02.181281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:02.182144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:02.188302 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:02.188758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:02.189539 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:02.189980 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:02.324508 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:02.332116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-18ad20e9-3b03-4463-b6b3-e3894c59989d tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1673 microversion: 2.1 time: 0.156753 Jul 28 22:35:02.332776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 451/912] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:02 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:02.789057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-dfd0c7cf-bc52-4aec-b713-081685b1d70e req-06135010-029a-4de0-88b4-55fdad5cbd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9e8c61-8952-40e4-86d5-4e525b6c5fb6", "name": "network-vif-deleted", "tag": "60c34db1-525c-473a-a014-73ac0c1156d9"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:02.793951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:02.794742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=6 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:02.801220 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-dfd0c7cf-bc52-4aec-b713-081685b1d70e req-06135010-029a-4de0-88b4-55fdad5cbd21 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:02.802066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-dfd0c7cf-bc52-4aec-b713-081685b1d70e req-06135010-029a-4de0-88b4-55fdad5cbd21 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:02.806382 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:02.814036 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-dfd0c7cf-bc52-4aec-b713-081685b1d70e req-06135010-029a-4de0-88b4-55fdad5cbd21 service nova] Creating event network-vif-deleted:60c34db1-525c-473a-a014-73ac0c1156d9 for instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 on hv-cinder-85093 Jul 28 22:35:02.819753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-dfd0c7cf-bc52-4aec-b713-081685b1d70e req-06135010-029a-4de0-88b4-55fdad5cbd21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034486 Jul 28 22:35:02.820345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 462/913] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:03.022777 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:03.023303 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:03.025733 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:03.031938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:03.032393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:03.033170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:03.033636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:03.173079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:03.181620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-998b2692-9db8-4c60-ab9e-3e0573323b84 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1314 microversion: 2.1 time: 0.163363 Jul 28 22:35:03.189758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 452/914] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:03 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:03.358435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:03.359857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:03.369016 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:03.369554 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:03.370321 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:03.370763 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:03.403287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:03.404009 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:03.404459 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lazy-loading 'fault' on Instance uuid 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:03.451079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7476eccb0a6f4195936bec75f7f80c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd829cbd8678145668ea811e01093fcfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:03.459761 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e7c23b30-2ae0-48f6-abbf-f42fe7312be7 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 200 len: 1325 microversion: 2.1 time: 0.109137 Jul 28 22:35:03.460339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 463/915] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:03 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 1325 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:04.202950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:04.203489 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:04.210086 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.210531 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.211286 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.211717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.343048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:04.351059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d68971d1-dab4-4648-a1c0-4c55cc554f8a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1497 microversion: 2.1 time: 0.152034 Jul 28 22:35:04.351622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 453/916] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:04 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:04.481625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:04.482192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:04.488890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.490563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.491338 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.491785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.506601 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 HTTP/1.1 Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:04.508245 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:04.510128 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '6d9e8c61-8952-40e4-86d5-4e525b6c5fb6'} Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:04.511452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:04.513219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:04.514760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:04.514760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ba2e606b-168d-46c8-b25f-fbf835e3c89c tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 404 len: 111 microversion: 2.1 time: 0.032314 Jul 28 22:35:04.514760 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 464/917] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:04 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:04.519235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f25d3b44-49e5-47c3-867e-dbd7a44067e2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '.version_select at 0x7f743c100280>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:04.539191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f25d3b44-49e5-47c3-867e-dbd7a44067e2 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96214369" status: 202 len: 0 microversion: 2.1 time: 0.023845 Jul 28 22:35:04.540052 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 454/918] 10.222.0.39 () {58 vars in 1215 bytes} [Thu Jul 28 22:35:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96214369 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:35:04.790274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:04.790907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:04.797396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.798020 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.798891 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.799707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.829497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:04.928374 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5c5c47df-6623-415a-8201-d655feae8422 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 204 len: 0 microversion: 2.1 time: 0.142598 Jul 28 22:35:04.929213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 465/919] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:04 2022] DELETE /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:35:04.937674 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:04.938296 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:04.945961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.946420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:04.947200 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:04.947642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:05.137557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:05.152343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-137a636f-99e5-4429-b9d7-0fd1abd3dc4c tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1503 microversion: 2.1 time: 0.218136 Jul 28 22:35:05.153427 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 455/920] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:04 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:06.178926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:06.179632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:06.186176 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:06.186621 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:06.187381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:06.187818 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:06.318005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:06.325710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-39e4ce73-c63f-4b7a-bfb2-bca58bd3b65a tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1503 microversion: 2.1 time: 0.151755 Jul 28 22:35:06.326280 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 466/921] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:06 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:06.950771 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-87ff1f73-c449-4cae-8cb4-d4785595ebc4 req-1a6c5ef3-4e77-4984-a73b-328df8ee6753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0d4bc8-8ab6-4173-9444-bd1af30c7b27", "name": "network-vif-deleted", "tag": "916808d8-9c55-4a8a-8cc1-d5309bf50c19"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:06.963898 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-87ff1f73-c449-4cae-8cb4-d4785595ebc4 req-1a6c5ef3-4e77-4984-a73b-328df8ee6753 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:06.964371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-87ff1f73-c449-4cae-8cb4-d4785595ebc4 req-1a6c5ef3-4e77-4984-a73b-328df8ee6753 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:06.978388 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-87ff1f73-c449-4cae-8cb4-d4785595ebc4 req-1a6c5ef3-4e77-4984-a73b-328df8ee6753 service nova] Creating event network-vif-deleted:916808d8-9c55-4a8a-8cc1-d5309bf50c19 for instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 on hv-cinder-85093 Jul 28 22:35:06.983078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-87ff1f73-c449-4cae-8cb4-d4785595ebc4 req-1a6c5ef3-4e77-4984-a73b-328df8ee6753 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036002 Jul 28 22:35:06.984177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 456/922] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:07.345905 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:07.346528 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:07.354634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.355268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.356037 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.356475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.393083 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.393555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.394011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lazy-loading 'fault' on Instance uuid 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:07.435643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:07.444085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-aef05cba-611c-43e0-8a1b-dce4abd3ec6b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 200 len: 1304 microversion: 2.1 time: 0.102054 Jul 28 22:35:07.444752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 467/923] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:07 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:07.567124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:07.567931 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:07.574421 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.574869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.575639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.576068 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.589840 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 HTTP/1.1 Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:07.591410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.592940 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '6d9e8c61-8952-40e4-86d5-4e525b6c5fb6'} Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:07.594124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.595590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.597027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:07.597027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-07181bd7-412a-4eb4-893e-5cd96249a2da tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jul 28 22:35:07.597027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 457/924] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:07 2022] DELETE /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:07.602331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:07.603448 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:07.609496 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.610241 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.611418 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:07.611999 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:07.625670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 HTTP/1.1 Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:07.627301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.629161 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '6d9e8c61-8952-40e4-86d5-4e525b6c5fb6'} Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:07.630236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. Jul 28 22:35:07.631822 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:07.633335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:07.633335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-10157714-f45a-4450-98de-57f119d2fc39 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6" status: 404 len: 111 microversion: 2.1 time: 0.031485 Jul 28 22:35:07.633335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 468/925] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:07 2022] GET /compute/v2.1/servers/6d9e8c61-8952-40e4-86d5-4e525b6c5fb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:08.467817 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:08.468371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:08.474797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.475242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.475992 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.476422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.490110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] HTTP exception thrown: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Request method failure captured: Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 HTTP/1.1 Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w8KGdSTnVNzdIliB9XOSlPhBcao6Wrp_sizU_b61sWgYAGV-ZTmFtARXDNwyDWQhvz-BE7KUNIOeFinp5Jhq5uTLKLsoQWZ7VbZFzO7hKdHCwgDLJFwclDB6XiojlMEiLPUN0UbqkNuXWWyDI3DPvDmtBU59OJGWxLubrEhk7RJ9ys Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: f5144f6ac53848fe84bdcb15e5242f1d Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesActionsTest-496174629 Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:08.491603 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesActionsTest-496174629 Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: f5144f6ac53848fe84bdcb15e5242f1d Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesActionsTest-496174629 Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesActionsTest-496174629-project Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d649218b6ae047c480de9640727aaded Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesActionsTest-496174629-project Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. Jul 28 22:35:08.493970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '8e0d4bc8-8ab6-4173-9444-bd1af30c7b27'} Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:08.495428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. Jul 28 22:35:08.497707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.499827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Returning 404 to user: Instance 8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:08.499827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5ab2aab4-d427-4ec4-92ee-0e30d5e956bd tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27" status: 404 len: 111 microversion: 2.1 time: 0.029149 Jul 28 22:35:08.499827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 458/926] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:08 2022] GET /compute/v2.1/servers/8e0d4bc8-8ab6-4173-9444-bd1af30c7b27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:08.542902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-385731206", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452", "networks": [{"uuid": "0ffc9792-b9bf-47d9-8c02-0f7cb45eec99"}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:08.596428 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] validate_networks() for [('0ffc9792-b9bf-47d9-8c02-0f7cb45eec99', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:35:08.767926 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:08.768631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:08.775496 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.775950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.776725 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.777163 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.792066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 HTTP/1.1 Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:08.793651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.795209 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '8cc2682a-cbca-49c8-8e74-2d9ed7062e93'} Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:08.796125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.797600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.798981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:08.798981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-595d385b-38e4-4cf1-a6bd-5c24015865b6 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 404 len: 111 microversion: 2.1 time: 0.030967 Jul 28 22:35:08.798981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 459/927] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:08 2022] DELETE /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:35:08.804232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:08.804840 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] [instance: 8cc2682a-cbca-49c8-8e74-2d9ed7062e93] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:08.810863 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.811315 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.812080 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:08.812514 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:08.826487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] HTTP exception thrown: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Request method failure captured: Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 HTTP/1.1 Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w1-SWnkG24M6WdgYp1mOYflAOcAEyYijw8eSd146EyG5ycZkVSJsXj-P7iHLo6LXXhoGW0K0sL1Kqa5W4A-tzPq6hvr-XBX5HVDT_F7SAZV1aSalMTsYHU-qwoynVUOO0LCgsxvYxWVlOvWbUkejUE25w1Jmm00Ir_KUiQtfvMxcdY Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:08.828020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d829cbd8678145668ea811e01093fcfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d829cbd8678145668ea811e01093fcfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d829cbd8678145668ea811e01093fcfc Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914910554 Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 7476eccb0a6f4195936bec75f7f80c7d Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeTestJSON-914910554-project Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.829632 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '8cc2682a-cbca-49c8-8e74-2d9ed7062e93'} Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:08.830529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. Jul 28 22:35:08.831950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:08.833281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] Returning 404 to user: Instance 8cc2682a-cbca-49c8-8e74-2d9ed7062e93 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:08.833281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-57e82567-3c62-48c6-bec7-f757d2e6e988 tempest-AttachVolumeTestJSON-914910554 tempest-AttachVolumeTestJSON-914910554-project] 10.222.0.39 "GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93" status: 404 len: 111 microversion: 2.1 time: 0.029943 Jul 28 22:35:08.834103 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 460/928] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:08 2022] GET /compute/v2.1/servers/8cc2682a-cbca-49c8-8e74-2d9ed7062e93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:09.200094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:35:09.200519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:35:09.200997 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:35:09.201407 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:35:09.201854 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:35:09.211301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:09.211751 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:09.212550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:09.212983 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:09.236178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Getting quotas for project f5144f6ac53848fe84bdcb15e5242f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:35:09.240900 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Getting quotas for user d649218b6ae047c480de9640727aaded and project f5144f6ac53848fe84bdcb15e5242f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:35:09.254840 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:35:09.257802 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:35:09.316204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-7e09af66-945f-4a5e-8a0a-fb63282c7a00 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777043 Jul 28 22:35:09.317186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 469/929] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:35:09.328330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-93fc704d-a511-4a27-9ae3-5b0bfaf40682 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:09.328953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-93fc704d-a511-4a27-9ae3-5b0bfaf40682 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:09.406872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-93fc704d-a511-4a27-9ae3-5b0bfaf40682 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:09.414697 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-93fc704d-a511-4a27-9ae3-5b0bfaf40682 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1213 microversion: 2.1 time: 0.090033 Jul 28 22:35:09.415237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 461/930] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:09 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:10.436258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:10.436947 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:10.444701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:10.445156 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:10.445991 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:10.446430 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:10.514444 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:10.522309 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b7ecb88d-cb7b-45f5-9936-148e5da2e0f3 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1273 microversion: 2.1 time: 0.090454 Jul 28 22:35:10.523097 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 470/931] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:10 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:11.544174 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:11.545454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:11.554694 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:11.554881 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:11.555727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:11.556476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:11.791792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:11.800302 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1e8a92a9-cf94-447c-a228-db95ed9a00d5 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.260168 Jul 28 22:35:11.811184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 462/932] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:11 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:12.341181 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-3cee7491-8aa0-47ed-89eb-bd5b4171ab49 req-29a66a15-2574-4fe4-8d33-c9a6206a380c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820c9bda-1008-4e9f-8655-d375d179a4f4", "tag": "66bee7fd-83e5-4040-b6e8-469c5ed01edd"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:12.360378 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3cee7491-8aa0-47ed-89eb-bd5b4171ab49 req-29a66a15-2574-4fe4-8d33-c9a6206a380c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:12.361271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3cee7491-8aa0-47ed-89eb-bd5b4171ab49 req-29a66a15-2574-4fe4-8d33-c9a6206a380c service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:12.383063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-3cee7491-8aa0-47ed-89eb-bd5b4171ab49 req-29a66a15-2574-4fe4-8d33-c9a6206a380c service nova] Creating event network-changed:66bee7fd-83e5-4040-b6e8-469c5ed01edd for instance 820c9bda-1008-4e9f-8655-d375d179a4f4 on hv-cinder-85093 Jul 28 22:35:12.402466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-3cee7491-8aa0-47ed-89eb-bd5b4171ab49 req-29a66a15-2574-4fe4-8d33-c9a6206a380c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065083 Jul 28 22:35:12.408982 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 471/933] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:12.822735 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:12.823408 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:12.830707 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:12.831333 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:12.832484 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:12.833191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:12.985426 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:12.994977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-89743cc5-b237-415a-956d-5f5870dd411f tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.176279 Jul 28 22:35:12.995861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 463/934] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:12 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:14.017263 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:14.018012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:14.021862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:14.035381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:14.036361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:14.039329 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:14.039928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:14.192917 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:14.201178 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-adbacbc3-ab68-4f19-9851-d671f56b4c8b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.188527 Jul 28 22:35:14.201995 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 472/935] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:14 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:15.222655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:15.224032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:15.230967 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:15.231415 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:15.232167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:15.232598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:15.364029 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:15.371713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3b43124a-2fff-4e77-8bc5-a97f4aa46d3b tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.152962 Jul 28 22:35:15.372313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 464/936] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:15 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:16.392100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:16.392698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:16.399898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:16.400351 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:16.401114 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:16.401563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:16.530462 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:16.538034 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ea8758a0-24a1-435c-87cc-67dc52f9d356 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.149752 Jul 28 22:35:16.538600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 473/937] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:16 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:17.558681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:17.559458 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:17.566271 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:17.566803 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:17.567660 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:17.568092 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:17.704037 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:17.711806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-418cdf48-86af-4308-8a7a-c151a7ae5af8 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.157019 Jul 28 22:35:17.712464 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 465/938] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:17 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:17.982434 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-27e2df20-adca-45d0-a02c-710cd0ac4cd4 req-af222a58-a5d6-4fa4-910c-3da8872c93c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820c9bda-1008-4e9f-8655-d375d179a4f4", "name": "network-vif-plugged", "status": "completed", "tag": "66bee7fd-83e5-4040-b6e8-469c5ed01edd"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:17.992835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-27e2df20-adca-45d0-a02c-710cd0ac4cd4 req-af222a58-a5d6-4fa4-910c-3da8872c93c3 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:17.993281 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-27e2df20-adca-45d0-a02c-710cd0ac4cd4 req-af222a58-a5d6-4fa4-910c-3da8872c93c3 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:18.005417 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-27e2df20-adca-45d0-a02c-710cd0ac4cd4 req-af222a58-a5d6-4fa4-910c-3da8872c93c3 service nova] Creating event network-vif-plugged:66bee7fd-83e5-4040-b6e8-469c5ed01edd for instance 820c9bda-1008-4e9f-8655-d375d179a4f4 on hv-cinder-85093 Jul 28 22:35:18.010258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-27e2df20-adca-45d0-a02c-710cd0ac4cd4 req-af222a58-a5d6-4fa4-910c-3da8872c93c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 Jul 28 22:35:18.011050 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 474/939] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:18.732190 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:18.733410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:18.744323 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:18.744777 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:18.745570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:18.746024 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:18.886248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:18.893847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-71877844-2791-4059-a027-4a3aaceb4e33 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.165520 Jul 28 22:35:18.894403 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 466/940] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:18 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:19.545859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:19.546613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=6 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:19.551456 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:19.552055 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:19.559344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:19.559810 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:19.560600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:19.561174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:19.586464 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2a596da5-9347-4bf0-9124-1a4a02494204 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/ips" status: 200 len: 151 microversion: 2.1 time: 0.041996 Jul 28 22:35:19.587048 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 475/941] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:35:19 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:19.916994 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:19.917652 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:19.919582 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:19.929136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:19.929647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:19.930436 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:19.930872 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:20.081066 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:20.092748 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0380bf70-4acb-473d-bba8-0a3d48e17e16 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1313 microversion: 2.1 time: 0.179915 Jul 28 22:35:20.106038 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 467/942] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:19 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:20.927670 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c9b2044-78b7-431d-b163-5ad75a6bb56c"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:20.930012 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:20.936504 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:20.936953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:20.937757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:20.938196 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:21.114800 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:21.115509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:21.122175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:21.122564 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:21.123329 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:21.123754 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:21.208258 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d8b8970d-c143-46f7-93a2-c8f2e8c5ad20 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "POST /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284692 Jul 28 22:35:21.209017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 476/943] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:35:20 2022] POST /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:21.279442 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:21.288450 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0f5dfe9c-1cd3-46ad-a0ef-30e15868f1a0 tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1496 microversion: 2.1 time: 0.177959 Jul 28 22:35:21.289550 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 468/944] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:21 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1496 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:21.917191 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:21.917817 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:21.924061 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:21.924511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:21.925272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:21.925849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:21.950341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:21.998481 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:22.025170 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-2d01e478-3bd6-40ec-a82a-cb3d6597db3e tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "DELETE /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 204 len: 0 microversion: 2.1 time: 0.112328 Jul 28 22:35:22.025875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 477/945] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:21 2022] DELETE /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:35:22.034047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:22.034668 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:22.041651 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:22.042312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:22.043075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:22.043507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:22.047988 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=100 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:22.172187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:22.180272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9d2a233b-81c0-4613-b0ed-769e50c6c3df tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1502 microversion: 2.1 time: 0.150133 Jul 28 22:35:22.180830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 469/946] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:22 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:23.202021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:23.202744 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:23.209884 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:23.210330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:23.211097 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:23.211526 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:23.357847 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:23.366109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-38cad212-291b-48a8-b368-7a6d56493dbb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1502 microversion: 2.1 time: 0.168146 Jul 28 22:35:23.366694 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 478/947] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:23 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:24.004944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-2939efc8-8e8f-4594-a5ab-1d5f2b77b3b5 req-179e536e-2744-4981-a58c-9283c495ccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820c9bda-1008-4e9f-8655-d375d179a4f4", "name": "network-vif-deleted", "tag": "66bee7fd-83e5-4040-b6e8-469c5ed01edd"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:24.010389 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:24.016867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-2939efc8-8e8f-4594-a5ab-1d5f2b77b3b5 req-179e536e-2744-4981-a58c-9283c495ccd9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:24.017742 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-2939efc8-8e8f-4594-a5ab-1d5f2b77b3b5 req-179e536e-2744-4981-a58c-9283c495ccd9 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:24.031871 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-2939efc8-8e8f-4594-a5ab-1d5f2b77b3b5 req-179e536e-2744-4981-a58c-9283c495ccd9 service nova] Creating event network-vif-deleted:66bee7fd-83e5-4040-b6e8-469c5ed01edd for instance 820c9bda-1008-4e9f-8655-d375d179a4f4 on hv-cinder-85093 Jul 28 22:35:24.039621 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-2939efc8-8e8f-4594-a5ab-1d5f2b77b3b5 req-179e536e-2744-4981-a58c-9283c495ccd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040749 Jul 28 22:35:24.040234 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 470/948] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:24.391185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:24.392282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:24.401035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:24.401489 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:24.402439 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:24.402786 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:24.459804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:24.460392 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:24.460952 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lazy-loading 'fault' on Instance uuid 820c9bda-1008-4e9f-8655-d375d179a4f4 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:24.521132 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd649218b6ae047c480de9640727aaded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5144f6ac53848fe84bdcb15e5242f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:24.529049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-dd9aae43-00da-49d1-a75e-184e985807fb tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 200 len: 1303 microversion: 2.1 time: 0.143964 Jul 28 22:35:24.533602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 479/949] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:24 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:25.551506 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:25.552386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] [instance: 820c9bda-1008-4e9f-8655-d375d179a4f4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:25.558780 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:25.559393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:25.560168 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:25.560714 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:25.575907 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] HTTP exception thrown: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Request method failure captured: Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 HTTP/1.1 Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w8KGdSTnVNzdIliB9XOSlPhBcao6Wrp_sizU_b61sWgYAGV-ZTmFtARXDNwyDWQhvz-BE7KUNIOeFinp5Jhq5uTLKLsoQWZ7VbZFzO7hKdHCwgDLJFwclDB6XiojlMEiLPUN0UbqkNuXWWyDI3DPvDmtBU59OJGWxLubrEhk7RJ9ys Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: f5144f6ac53848fe84bdcb15e5242f1d Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesActionsTest-496174629 Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:25.577482 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f5144f6ac53848fe84bdcb15e5242f1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesActionsTest-496174629 Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: f5144f6ac53848fe84bdcb15e5242f1d Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesActionsTest-496174629 Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesActionsTest-496174629-project Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d649218b6ae047c480de9640727aaded Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesActionsTest-496174629-project Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. Jul 28 22:35:25.579078 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '820c9bda-1008-4e9f-8655-d375d179a4f4'} Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:25.579995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. Jul 28 22:35:25.581486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:25.583529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] Returning 404 to user: Instance 820c9bda-1008-4e9f-8655-d375d179a4f4 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:25.583529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c1a61569-19ac-4a59-a628-5b43b52d259d tempest-VolumesActionsTest-496174629 tempest-VolumesActionsTest-496174629-project] 10.222.0.39 "GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4" status: 404 len: 111 microversion: 2.1 time: 0.032220 Jul 28 22:35:25.583529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 471/950] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:25 2022] GET /compute/v2.1/servers/820c9bda-1008-4e9f-8655-d375d179a4f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:31.034213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:31.036540 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:31.044650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:31.045434 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:31.046795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:31.047485 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:31.151253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'services' on Instance uuid 63c132dc-7c92-4660-afaa-1dd24ffa061f {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:31.246063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d21f0c6e-57ab-48cb-aaf9-c6cfc69c9d0e tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments/4c9b2044-78b7-431d-b163-5ad75a6bb56c" status: 202 len: 0 microversion: 2.1 time: 0.215966 Jul 28 22:35:31.247545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 480/951] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:35:31 2022] DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments/4c9b2044-78b7-431d-b163-5ad75a6bb56c => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:35:31.257281 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:31.259579 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:31.267961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:31.268417 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:31.269710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:31.270439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:31.309620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-37aa19aa-adb4-4572-ab77-ed13702f86fe tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057761 Jul 28 22:35:31.310090 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 472/952] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:35:31 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:32.334966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:32.338511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:32.351616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.352283 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:32.353660 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.354475 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:32.410564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1946bb7a-0664-45ea-a7f2-4ee598c2fe02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090427 Jul 28 22:35:32.411307 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 481/953] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:35:32 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:35:32.523452 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:32.523983 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:32.537122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.537600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:32.538378 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.538815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:32.568767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:32.674457 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f1fc6fa3-5e6c-47f3-b09a-2398267c8167 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 204 len: 0 microversion: 2.1 time: 0.158597 Jul 28 22:35:32.676220 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 473/954] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:32 2022] DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:35:32.684505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:32.685678 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:32.692269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.692956 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:32.693955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:32.694583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.016944 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:33.031123 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-a8847791-a595-4b7d-a7cf-0b72ad9c57d1 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1683 microversion: 2.1 time: 0.350222 Jul 28 22:35:33.032398 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 482/955] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:32 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1683 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:33.364173 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:33.366665 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:33.373222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.373709 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.374500 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.374941 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.409371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-66d925ef-20d0-416f-af8a-5bec3762d2c4 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050678 Jul 28 22:35:33.410866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 474/956] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Jul 28 22:35:33 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:33.478916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:33.479493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:33.487057 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.487517 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.489152 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.489273 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.516332 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:33.614235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b3c16483-caa6-4aad-b617-14c2d4a4217e tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 204 len: 0 microversion: 2.20 time: 0.139269 Jul 28 22:35:33.614889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 483/957] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Jul 28 22:35:33 2022] DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 22:35:33.623035 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:33.623669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:33.631322 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.632013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.632792 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:33.633231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:33.783366 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:33.792607 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:33.794159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:33.795335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d9544186-5699-4d18-b619-0f2c988cc77d tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.176260 Jul 28 22:35:33.795888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 475/958] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:33 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:35:34.053593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:34.054278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:34.060455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:34.061109 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:34.061940 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:34.062383 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:34.212765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:34.229556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0e2d2d54-40a7-4e47-bcde-11da887a5069 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1683 microversion: 2.1 time: 0.180266 Jul 28 22:35:34.231084 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 484/959] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:34 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:34.819202 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:34.819820 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:34.828141 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:34.828593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:34.838216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:34.838896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:35.003847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:35.013666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:35.016260 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:35.019069 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-dd80cbbc-2bbe-40ce-9fc2-632d32c089f0 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.203211 Jul 28 22:35:35.020486 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 476/960] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:34 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:35:35.252728 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:35.253391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:35.261158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:35.261905 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:35.263032 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:35.263640 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:35.462221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:35.471029 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d8267e5e-7a63-4504-92cf-01ba71ebb401 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1683 microversion: 2.1 time: 0.222591 Jul 28 22:35:35.484916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 485/961] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:35 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1683 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:36.045544 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:36.048121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:36.057313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:36.058389 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:36.059338 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:36.060343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:36.248428 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:36.258868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:36.260399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:36.261829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0176e7e1-d61f-48ff-8e36-81e7c19034d6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1725 microversion: 2.20 time: 0.220764 Jul 28 22:35:36.275204 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 477/962] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:36 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:35:36.503248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:36.506073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:36.516319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:36.517060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:36.518704 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:36.519930 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:36.824729 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:36.840466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1b3a7fde-9428-4068-8553-275fd3e69a02 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1683 microversion: 2.1 time: 0.350372 Jul 28 22:35:36.843574 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 486/963] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:36 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1683 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:37.288683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:37.289447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:37.306741 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.307801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.308914 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.309739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.424143 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:37.441239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:37.446710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:37.449020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-599af5ed-eb4a-43a9-92a3-dbe464781504 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1657 microversion: 2.20 time: 0.165073 Jul 28 22:35:37.453479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 478/964] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:37 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 22:35:37.604479 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-1ce3163b-013e-4e86-b416-22bde5ad54a5 req-51354a6d-2e6d-45ee-86bf-d4389dc641da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c132dc-7c92-4660-afaa-1dd24ffa061f", "name": "network-vif-deleted", "tag": "331a5f1a-4b53-4977-9650-7b036b77770c"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:37.640338 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1ce3163b-013e-4e86-b416-22bde5ad54a5 req-51354a6d-2e6d-45ee-86bf-d4389dc641da service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.640800 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1ce3163b-013e-4e86-b416-22bde5ad54a5 req-51354a6d-2e6d-45ee-86bf-d4389dc641da service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.682918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-1ce3163b-013e-4e86-b416-22bde5ad54a5 req-51354a6d-2e6d-45ee-86bf-d4389dc641da service nova] Creating event network-vif-deleted:331a5f1a-4b53-4977-9650-7b036b77770c for instance 63c132dc-7c92-4660-afaa-1dd24ffa061f on hv-cinder-85093 Jul 28 22:35:37.689681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-1ce3163b-013e-4e86-b416-22bde5ad54a5 req-51354a6d-2e6d-45ee-86bf-d4389dc641da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089149 Jul 28 22:35:37.691023 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 487/965] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:37.865130 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:37.865775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:37.887674 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.889179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.890385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.890982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.985406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:37.987493 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:37.988553 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lazy-loading 'fault' on Instance uuid 63c132dc-7c92-4660-afaa-1dd24ffa061f {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:38.130819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38b517910894f7fa4351a2120b466d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c7b146e08f4a9ea11f1a73099eb7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:38.150361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-9380e22d-1ccc-4246-970b-64dfcc3de796 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 200 len: 1332 microversion: 2.1 time: 0.289244 Jul 28 22:35:38.157503 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 479/966] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:37 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:38.477896 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:38.479518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:38.492596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:38.495524 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:38.498085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:38.498720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:38.551253 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:38.551611 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:38.552399 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.objects.instance [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lazy-loading 'fault' on Instance uuid 4c641cce-d011-422d-9a7a-268910d8d1a4 {{(pid=118086) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:35:38.603508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:38.616910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:38.619300 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e13e8c76cb4757a42568112d16bd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4e68e56e744fa9af4631ae2e967a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:38.621230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e6e716a8-97f1-499d-bc70-ea0f4deafd4c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 200 len: 1371 microversion: 2.20 time: 0.148545 Jul 28 22:35:38.637142 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 488/967] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:38 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 22:35:39.182356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.182964 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:39.198941 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.200216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.201407 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.202165 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.222559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f HTTP/1.1 Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:39.224433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:39.226120 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '63c132dc-7c92-4660-afaa-1dd24ffa061f'} Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:39.231036 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:39.232561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.233938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:39.233938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-379c4257-029f-4d60-8b09-9a9eb73e4227 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 404 len: 111 microversion: 2.1 time: 0.047434 Jul 28 22:35:39.233938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 480/968] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:39 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:39.240190 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-794bbbb0-6de9-4736-a457-18a2ee3ca409 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '.version_select at 0x7f743c0e3dc0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.302676 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.304060 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:39.315414 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-794bbbb0-6de9-4736-a457-18a2ee3ca409 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277343325" status: 202 len: 0 microversion: 2.1 time: 0.082195 Jul 28 22:35:39.317555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 489/969] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Jul 28 22:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277343325 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:35:39.323423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.324114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.325929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.327084 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.389639 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:39.535825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c444ff22-8a38-4a54-a73c-3be4c6df498e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 204 len: 0 microversion: 2.1 time: 0.251769 Jul 28 22:35:39.537833 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 481/970] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:39 2022] DELETE /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:35:39.546570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.548022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:39.564339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.570916 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.572065 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.574609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.649301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.650199 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:39.663033 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.663638 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.666778 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.667504 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.702056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 HTTP/1.1 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:39.710256 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:39.711765 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '4c641cce-d011-422d-9a7a-268910d8d1a4'} Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:39.712557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:39.713957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:39.719485 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:39.720656 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-afc58aca-8c14-4396-a0f3-a04f0ba5505b tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 404 len: 111 microversion: 2.20 time: 0.076756 Jul 28 22:35:39.722827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 482/971] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:39 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 22:35:39.730824 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6425f2bf-ec40-432c-8e89-3265ac9c1ae2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '.version_select at 0x7f743c12c820>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:39.808032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6425f2bf-ec40-432c-8e89-3265ac9c1ae2 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791566338" status: 204 len: 0 microversion: 2.20 time: 0.080421 Jul 28 22:35:39.808911 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 483/972] 10.222.0.39 () {60 vars in 1259 bytes} [Thu Jul 28 22:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791566338 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 22:35:39.826761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-e7de3c02-3de2-47c9-abd0-422412f8b1c4 req-8a748129-6e82-44f0-a364-62595dfca2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c641cce-d011-422d-9a7a-268910d8d1a4", "name": "network-vif-deleted", "tag": "b0004cc7-da74-484e-8822-e521573b9c72"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:39.881077 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-e7de3c02-3de2-47c9-abd0-422412f8b1c4 req-8a748129-6e82-44f0-a364-62595dfca2f7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:39.900804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-e7de3c02-3de2-47c9-abd0-422412f8b1c4 req-8a748129-6e82-44f0-a364-62595dfca2f7 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:39.926206 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-e7de3c02-3de2-47c9-abd0-422412f8b1c4 req-8a748129-6e82-44f0-a364-62595dfca2f7 service nova] Creating event network-vif-deleted:b0004cc7-da74-484e-8822-e521573b9c72 for instance 4c641cce-d011-422d-9a7a-268910d8d1a4 on hv-cinder-85093 Jul 28 22:35:39.941636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-e7de3c02-3de2-47c9-abd0-422412f8b1c4 req-8a748129-6e82-44f0-a364-62595dfca2f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130958 Jul 28 22:35:39.945126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 484/973] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:40.122869 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:40.137641 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4a037c48-cb17-46ca-a795-5b77d728df25 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1579 microversion: 2.1 time: 0.593464 Jul 28 22:35:40.138293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 490/974] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:39 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1579 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:41.164423 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:41.165027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:41.179740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:41.180443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:41.181461 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:41.182091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:41.406592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:41.422750 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d466b903-bc06-4966-9968-c2434e30acc4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1579 microversion: 2.1 time: 0.262913 Jul 28 22:35:41.424194 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 485/975] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:41 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1579 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:41.956849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:41.957468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:41.968438 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:41.973330 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:41.978625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:41.979331 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:41.999853 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f HTTP/1.1 Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:42.004966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.006487 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '63c132dc-7c92-4660-afaa-1dd24ffa061f'} Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:42.007248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.008546 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.012346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:42.012346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6354ce82-4bf1-40d7-97ec-19dfc11ae9da tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 404 len: 111 microversion: 2.1 time: 0.055597 Jul 28 22:35:42.012346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 491/976] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:41 2022] DELETE /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:42.017356 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:42.018030 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 63c132dc-7c92-4660-afaa-1dd24ffa061f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:42.028187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.028952 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.030121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.030843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.057663 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f HTTP/1.1 Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:42.066398 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.067857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '63c132dc-7c92-4660-afaa-1dd24ffa061f'} Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:42.068590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. Jul 28 22:35:42.071058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.074409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 63c132dc-7c92-4660-afaa-1dd24ffa061f could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:42.074409 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0ba447d9-f33a-4ee2-9c4d-1af8d53eb28a tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f" status: 404 len: 111 microversion: 2.1 time: 0.057375 Jul 28 22:35:42.078343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 486/977] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:42 2022] GET /compute/v2.1/servers/63c132dc-7c92-4660-afaa-1dd24ffa061f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:42.384497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:42.385488 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:42.399049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.399792 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.400888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.401593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.447815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:42.449301 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:42.458544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 HTTP/1.1 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:42.460888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.462620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '4c641cce-d011-422d-9a7a-268910d8d1a4'} Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:42.463555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.464749 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.466330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.466797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.468806 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:42.470045 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.471814 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.476986 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:42.479862 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0c5a4a3f-a2dd-4870-986b-cbd8c4f659e1 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 404 len: 111 microversion: 2.20 time: 0.101727 Jul 28 22:35:42.482078 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 492/978] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Jul 28 22:35:42 2022] DELETE /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:35:42.493794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:42.494695 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 4c641cce-d011-422d-9a7a-268910d8d1a4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:42.505701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.506437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.507397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.507989 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.542898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 HTTP/1.1 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:42.545274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.547354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '4c641cce-d011-422d-9a7a-268910d8d1a4'} Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:42.548298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. Jul 28 22:35:42.550828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:42.555266 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 4c641cce-d011-422d-9a7a-268910d8d1a4 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:42.556654 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ae1e330a-34b5-4acb-888a-442bdae75dff tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4" status: 404 len: 111 microversion: 2.20 time: 0.068810 Jul 28 22:35:42.557716 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 493/979] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:42 2022] GET /compute/v2.1/servers/4c641cce-d011-422d-9a7a-268910d8d1a4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 22:35:42.657085 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-b3b28692-767a-47c9-82a0-ced3aaa260c7 req-b6b1ccbc-2b34-47ee-8a6f-c3fa1f6dd9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47525846-7437-4e19-acd2-70f0ea466207", "name": "network-vif-deleted", "tag": "ac87f497-4264-4cef-8637-fb0c985ee2c9"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:42.687793 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:42.700478 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1b1407c6-b968-40df-8cb8-fe3c8d4a7c8e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 200 len: 1511 microversion: 2.1 time: 0.257386 Jul 28 22:35:42.701096 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 487/980] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:42 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:42.720441 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-b3b28692-767a-47c9-82a0-ced3aaa260c7 req-b6b1ccbc-2b34-47ee-8a6f-c3fa1f6dd9e8 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:42.722888 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-b3b28692-767a-47c9-82a0-ced3aaa260c7 req-b6b1ccbc-2b34-47ee-8a6f-c3fa1f6dd9e8 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:42.765422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-b3b28692-767a-47c9-82a0-ced3aaa260c7 req-b6b1ccbc-2b34-47ee-8a6f-c3fa1f6dd9e8 service nova] Creating event network-vif-deleted:ac87f497-4264-4cef-8637-fb0c985ee2c9 for instance 47525846-7437-4e19-acd2-70f0ea466207 on hv-cinder-85093 Jul 28 22:35:42.776583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-b3b28692-767a-47c9-82a0-ced3aaa260c7 req-b6b1ccbc-2b34-47ee-8a6f-c3fa1f6dd9e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124756 Jul 28 22:35:42.777692 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 494/981] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:43.331996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.332865 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.339683 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.340437 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.341425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.342151 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.358604 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 HTTP/1.1 Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:43.360726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.362996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '02901dd1-28e3-486f-a09c-3af63e2e81f2'} Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.364108 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.365609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.368171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.369300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-657a1050-1652-4e99-9b93-59a724348e21 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 404 len: 111 microversion: 2.1 time: 0.041381 Jul 28 22:35:43.370397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 488/982] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:43 2022] DELETE /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:43.380380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.381091 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 02901dd1-28e3-486f-a09c-3af63e2e81f2] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.391478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.392335 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.393124 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.394588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.429765 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 HTTP/1.1 Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:43.432909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.434257 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '02901dd1-28e3-486f-a09c-3af63e2e81f2'} Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.435006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. Jul 28 22:35:43.436505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.438073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 02901dd1-28e3-486f-a09c-3af63e2e81f2 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.438073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c5db431f-bc46-4e6c-b6e6-03f7f45eeb9c tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2" status: 404 len: 111 microversion: 2.1 time: 0.059564 Jul 28 22:35:43.438073 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 495/983] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:43 2022] GET /compute/v2.1/servers/02901dd1-28e3-486f-a09c-3af63e2e81f2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:43.443328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.445213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.455745 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.456509 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.457065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.462402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.482377 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb HTTP/1.1 Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:43.484079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.486121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'c5606c87-43fb-42b9-b876-929d94fff6bb'} Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.488076 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.491116 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.493361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.493361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-31be1b39-04e4-4318-837c-8b103541ca17 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 404 len: 111 microversion: 2.1 time: 0.046557 Jul 28 22:35:43.493361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 489/984] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:43 2022] DELETE /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:43.495468 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.496077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: c5606c87-43fb-42b9-b876-929d94fff6bb] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.502928 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.503723 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.504176 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.504674 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.528004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb HTTP/1.1 Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:43.529591 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.531436 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': 'c5606c87-43fb-42b9-b876-929d94fff6bb'} Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.532344 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. Jul 28 22:35:43.533827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.536359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance c5606c87-43fb-42b9-b876-929d94fff6bb could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.536359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-dc436de0-0233-40da-a4a0-e152cfbc6406 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb" status: 404 len: 111 microversion: 2.1 time: 0.039786 Jul 28 22:35:43.536359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 496/985] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:43 2022] GET /compute/v2.1/servers/c5606c87-43fb-42b9-b876-929d94fff6bb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:35:43.734162 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.734890 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.742962 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.748576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.749736 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.750369 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.772855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] HTTP exception thrown: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Request method failure captured: Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 HTTP/1.1 Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w6LbQ_yK4ridboghV3696PM3uyFUA80fa8wOJHpvXh5HI5qyxH8QXG8BbrA8pBmskdgrbgK0l3a2v2BxTiBeT06JpczuFTgtYMMRV_h1oRYaA0gdGuYPAek83KBgXQYm6XzldAnTzTeRQtQZ-4nQYvOOswX1yNJuRJxEPJXZSBuhGo Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:43.776633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-TestVolumeBootPattern-90937874 Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 32eadc02f9224eb28303aab25506ef2a Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:35:43.778410 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '47525846-7437-4e19-acd2-70f0ea466207'} Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.779362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:35:43.780932 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.783160 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Returning 404 to user: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.784789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0c044d4a-191f-4717-b3d7-5202b600b43a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 404 len: 111 microversion: 2.1 time: 0.054726 Jul 28 22:35:43.793938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 490/986] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:43 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:43.884163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.884980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.891909 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.897380 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.899278 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.900970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:43.913366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:43.943826 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 HTTP/1.1 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:35:43.945510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:43.949697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '782b475d-87bc-47f5-9cc2-4245086dc6c4'} Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:43.950778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:43.952163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:35:43.958600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:43.958600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1bac9c0e-465d-4f78-a148-315325b3517c tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 404 len: 111 microversion: 2.20 time: 0.068691 Jul 28 22:35:43.958912 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:43.960192 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] [instance: 782b475d-87bc-47f5-9cc2-4245086dc6c4] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:43.969543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 497/987] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Jul 28 22:35:43 2022] DELETE /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:35:43.985856 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:43.986825 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.011192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1513833947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305921694", "security_groups": [{"name": "tempest-secgroup-smoke-1337180336"}], "block_device_mapping_v2": [{"uuid": "0ac9a069-3311-4f99-8c87-673b861d9ecb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e"}]}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:44.012179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:44.012752 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.071948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:44.074385 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] HTTP exception thrown: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Request method failure captured: Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 HTTP/1.1 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w18fiuW-Tfws9tP19hzmBWL8LpCHq4kBpE8QrKAHLAQwTRMK4HjNusQ0lDuIv79573UbavoSfjXG7831gbuUzFuhhFm42uRB9TDV4bYyj20fV5RFYZ5bsTfJ9-UnKPTqWiBoj1PZykV3dmcb-FVjHy1dznNR-q9uPu6Pw0kxBJvLTM Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:44.079739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9c4e68e56e744fa9af4631ae2e967a6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 9c4e68e56e744fa9af4631ae2e967a6d Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1086805582 Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: b7e13e8c76cb4757a42568112d16bd27 Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1086805582-project Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:44.081593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '782b475d-87bc-47f5-9cc2-4245086dc6c4'} Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:44.082747 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. Jul 28 22:35:44.084177 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.085598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] Returning 404 to user: Instance 782b475d-87bc-47f5-9cc2-4245086dc6c4 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:44.085598 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0e1c1055-8c18-4be5-8f5c-accaeb6ce7a6 tempest-AttachVolumeShelveTestJSON-1086805582 tempest-AttachVolumeShelveTestJSON-1086805582-project] 10.222.0.39 "GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4" status: 404 len: 111 microversion: 2.20 time: 0.126902 Jul 28 22:35:44.087983 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 491/988] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Jul 28 22:35:43 2022] GET /compute/v2.1/servers/782b475d-87bc-47f5-9cc2-4245086dc6c4 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 22:35:44.555510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.network.neutron [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] validate_networks() for [('ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e', None, None, None, None, None)] {{(pid=118086) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:35:44.768187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:44.769679 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:44.778838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:44.779840 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.781055 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:44.781869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.803996 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f HTTP/1.1 Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:44.807425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.808821 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '41e2af9e-d8ce-4edd-8aae-4158d00ef92f'} Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:44.809628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.810870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.813917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:44.815805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ee296278-6e8e-4b0f-b7b3-d8f3d4109819 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 404 len: 111 microversion: 2.1 time: 0.051309 Jul 28 22:35:44.817069 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 492/989] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:44 2022] DELETE /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:35:44.830350 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:44.832053 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] [instance: 41e2af9e-d8ce-4edd-8aae-4158d00ef92f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:44.841642 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:44.842456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.843580 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:44.844196 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:44.863191 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] HTTP exception thrown: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Request method failure captured: Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f HTTP/1.1 Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w2Dn6Xr4RLVeIQ2tKJRhTJ-xXwFEA3s8PjU93YWKmXzlgXdYma34mA_ge1LMCGeF9rCzxgvctfZCqka_M5QO9QBmHP1SFV09mVnQYKU2TI0LNz4lDiiBGfxXLA6HqnP7mT4C9aQPVkMJ3eWOUHZIhfjwnvDewUexPVORxB4ua-2aYw Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:44.865698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d0c7b146e08f4a9ea11f1a73099eb7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: d0c7b146e08f4a9ea11f1a73099eb7ea Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805726073 Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: d38b517910894f7fa4351a2120b466d7 Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-AttachVolumeNegativeTest-805726073-project Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.867375 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '41e2af9e-d8ce-4edd-8aae-4158d00ef92f'} Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:44.868392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. Jul 28 22:35:44.869894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:44.872131 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] Returning 404 to user: Instance 41e2af9e-d8ce-4edd-8aae-4158d00ef92f could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:44.873243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-bc2ed2c9-63de-44ff-afce-f9d96f528c79 tempest-AttachVolumeNegativeTest-805726073 tempest-AttachVolumeNegativeTest-805726073-project] 10.222.0.39 "GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f" status: 404 len: 111 microversion: 2.1 time: 0.051045 Jul 28 22:35:44.874502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 493/990] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:44 2022] GET /compute/v2.1/servers/41e2af9e-d8ce-4edd-8aae-4158d00ef92f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:45.527893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:35:45.528887 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image limits 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:35:45.529676 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:35:45.530341 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image pref 0:0:0 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:35:45.531068 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.virt.hardware [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118086) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:35:45.564516 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:45.566553 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:45.567661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:45.568383 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:45.616186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:35:45.630168 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for user 32eadc02f9224eb28303aab25506ef2a and project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:35:45.796866 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Going to run 1 instances... {{(pid=118086) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:35:45.799268 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ac9a069-3311-4f99-8c87-673b861d9ecb',volume_size=None,volume_type=None)] {{(pid=118086) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:35:46.186297 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-883e1c6e-e894-4f0c-b0e1-9eec0538bb9b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.177305 Jul 28 22:35:46.196593 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 498/991] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:35:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:35:46.200773 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-978463cf-7922-46f7-81ad-f201f917e2bf tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:46.201627 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-978463cf-7922-46f7-81ad-f201f917e2bf tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:46.426571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-978463cf-7922-46f7-81ad-f201f917e2bf tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:46.433804 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-978463cf-7922-46f7-81ad-f201f917e2bf tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1095 microversion: 2.1 time: 0.238369 Jul 28 22:35:46.437770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 494/992] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:46 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1095 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:47.460962 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:47.462345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:47.486966 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:47.487778 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:47.488969 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:47.490265 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:47.626079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:47.645740 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-13bfe4e3-5ec3-4a20-9d9d-3cd4cc5250c3 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1193 microversion: 2.1 time: 0.187337 Jul 28 22:35:47.646478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 499/993] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:47 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1193 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:48.671870 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:48.673335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:48.692476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:48.699186 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:48.701061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:48.702218 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:48.929859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:48.939832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7980b31d-9780-4c7f-952d-a2b4b043f1f8 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1211 microversion: 2.1 time: 0.273138 Jul 28 22:35:48.940574 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 495/994] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:48 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:49.962359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:49.962954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:49.976976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:49.977736 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:49.990166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:49.990711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:50.085980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:50.107306 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-83ca8899-fbb6-4939-b38d-3f1e79bfa4c5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1199 microversion: 2.1 time: 0.141764 Jul 28 22:35:50.108595 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 500/995] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:49 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:50.797554 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:50.798201 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:50.810164 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:50.822559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:50.823791 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:50.824456 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:50.876032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:35:50.941512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-05924d53-306d-4b08-9745-aa4c4bc48969 req-67eece52-a2bb-47e2-a175-5d8c23d0c04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:50.969336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-05924d53-306d-4b08-9745-aa4c4bc48969 req-67eece52-a2bb-47e2-a175-5d8c23d0c04b service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:50.970044 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-05924d53-306d-4b08-9745-aa4c4bc48969 req-67eece52-a2bb-47e2-a175-5d8c23d0c04b service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:51.028627 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-05924d53-306d-4b08-9745-aa4c4bc48969 req-67eece52-a2bb-47e2-a175-5d8c23d0c04b service nova] Creating event network-changed:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:35:51.041556 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-05924d53-306d-4b08-9745-aa4c4bc48969 req-67eece52-a2bb-47e2-a175-5d8c23d0c04b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103352 Jul 28 22:35:51.042494 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 501/996] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:51.081896 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-da6d26f0-dd45-4b69-b610-9ea937f7df1d tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 204 len: 0 microversion: 2.1 time: 0.288111 Jul 28 22:35:51.083208 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 496/997] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:35:50 2022] DELETE /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:35:51.092573 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:51.093337 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:51.124581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:51.125040 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:51.125894 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:51.126404 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:51.135318 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:51.136354 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:51.148929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:51.150059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:51.152406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:51.155477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:51.565646 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:51.589149 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-90e4cdb7-1995-4a4a-a191-919738425982 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.499820 Jul 28 22:35:51.590808 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 502/998] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:51 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:51.654915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:51.670435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-969f479e-0dea-4388-99d0-f7cb0c64e173 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.539155 Jul 28 22:35:51.671097 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 497/999] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:51 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:52.627937 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:52.629385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:52.646359 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:52.650508 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:52.652906 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:52.657511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:52.702133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:52.702761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:52.717429 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:52.717949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:52.721439 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:52.722621 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:53.105504 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:53.117576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-1b71ec3b-7de2-4088-86ed-12c758a04046 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.424128 Jul 28 22:35:53.119801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 498/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:52 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:53.246325 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:53.260445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ce770d2f-d0ee-4377-878b-84f8d6e9a0f8 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.635005 Jul 28 22:35:53.262075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 503/1001] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:52 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:54.144020 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:54.147560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:54.173975 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:54.183031 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:54.184900 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:54.188422 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:54.189335 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:54.287493 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:54.288186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:54.312353 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:54.312813 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:54.313611 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:54.314234 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:54.469307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:54.482197 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cbf9fd4b-53e1-4014-becc-90268075a948 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.343569 Jul 28 22:35:54.485835 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 499/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:54 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:54.735173 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:54.782066 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ab23853e-3204-4c0f-bb36-cbb3df3c2480 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1568 microversion: 2.1 time: 0.498337 Jul 28 22:35:54.795833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 504/1003] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:54 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1568 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:55.160684 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-3bb89781-4f3b-43ac-80ee-21755f5daac4 req-306b3c6b-78eb-42d7-abb8-6a584fd35acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d00f8c1-cefc-4879-afad-88753b55d83f", "name": "network-vif-deleted", "tag": "2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:55.186407 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-3bb89781-4f3b-43ac-80ee-21755f5daac4 req-306b3c6b-78eb-42d7-abb8-6a584fd35acd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:55.194198 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-3bb89781-4f3b-43ac-80ee-21755f5daac4 req-306b3c6b-78eb-42d7-abb8-6a584fd35acd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:55.245245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-3bb89781-4f3b-43ac-80ee-21755f5daac4 req-306b3c6b-78eb-42d7-abb8-6a584fd35acd service nova] Creating event network-vif-deleted:2f1bb5bf-daa7-4786-b3bb-bf51eb4d81ec for instance 8d00f8c1-cefc-4879-afad-88753b55d83f on hv-cinder-85093 Jul 28 22:35:55.257254 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-3bb89781-4f3b-43ac-80ee-21755f5daac4 req-306b3c6b-78eb-42d7-abb8-6a584fd35acd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104578 Jul 28 22:35:55.270953 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 500/1004] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:55.511912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:55.512846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:55.525504 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:55.525938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:55.532000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:55.532472 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:55.631850 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:55.658376 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=6 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:55.808327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:55.811770 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:55.824441 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:55.826139 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:55.833059 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:55.833647 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:56.045556 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866795813bc545b5a9293ca714095679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2406f01f7b3b4941a0bcd97a68d3d510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:56.059021 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ee545831-a02e-4999-976b-9fdc4c8f07e5 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 200 len: 1219 microversion: 2.1 time: 0.255331 Jul 28 22:35:56.060075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 501/1005] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:55 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 1219 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:35:56.076816 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:56.090990 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-17e6b08c-0dd7-49f2-92b1-2ff64d557352 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.584070 Jul 28 22:35:56.094691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 505/1006] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:55 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:56.434044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:56.608578 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b30871ad-0846-480f-88cc-80c2ed6a537c tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Action: 'create', calling method: .version_select at 0x7f742ffcda60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-562460422", "metadata": {"Type": "work"}}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:57.022041 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b30871ad-0846-480f-88cc-80c2ed6a537c tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.637530 Jul 28 22:35:57.022787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 502/1007] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Jul 28 22:35:56 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 639 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 22:35:57.037099 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f1223d8f-039b-4a67-a854-a89d64a75675 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c1854c0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:57.081312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:57.082232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] [instance: 8d00f8c1-cefc-4879-afad-88753b55d83f] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:57.089688 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:57.090149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:57.090936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:57.091374 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:57.118510 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f1223d8f-039b-4a67-a854-a89d64a75675 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 200 len: 352 microversion: 2.1 time: 0.087275 Jul 28 22:35:57.119077 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 506/1008] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:35:57 2022] GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:57.123754 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:57.124527 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:57.128477 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] HTTP exception thrown: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Request method failure captured: Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f HTTP/1.1 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w3ybIgP9_EtiGCVq-q9-bBImRWNoMRBkRdzMJgjxItqvtRFcyM_d87JOScjj2qhV9WR2J3x-rJ9T5_PG87KBIMTKDedBfkWS346VqDAzw9Z3FgG3CZae-ZkLxoljxuaASlfhf5J-M1rboRl4xPs7HxDrnP93RXEChTRYUxEavdEbHY Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 2406f01f7b3b4941a0bcd97a68d3d510 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-TestShelveInstance-2114179531 Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:57.130412 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2406f01f7b3b4941a0bcd97a68d3d510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2406f01f7b3b4941a0bcd97a68d3d510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2406f01f7b3b4941a0bcd97a68d3d510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2406f01f7b3b4941a0bcd97a68d3d510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-TestShelveInstance-2114179531 Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 2406f01f7b3b4941a0bcd97a68d3d510 Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-TestShelveInstance-2114179531 Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-TestShelveInstance-2114179531-project Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 866795813bc545b5a9293ca714095679 Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-TestShelveInstance-2114179531-project Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. Jul 28 22:35:57.131831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '8d00f8c1-cefc-4879-afad-88753b55d83f'} Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:57.132600 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. Jul 28 22:35:57.134336 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:57.135420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Returning 404 to user: Instance 8d00f8c1-cefc-4879-afad-88753b55d83f could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:57.135420 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-96fa93c1-99ab-4c9b-b826-5a87f901aba0 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f" status: 404 len: 111 microversion: 2.1 time: 0.055577 Jul 28 22:35:57.135557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:57.135557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:57.135557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:57.135557 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:57.135843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 503/1009] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:57 2022] GET /compute/v2.1/servers/8d00f8c1-cefc-4879-afad-88753b55d83f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:35:57.331863 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:57.336630 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-89aab985-0806-4cd7-9bee-87db7d48e819 req-e35eef2b-750a-4113-b930-f9b7a0474d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a0bb72-6ab1-4e67-a33f-3f93da40cfee", "tag": "1c06568b-ba30-4d2c-81ad-0bf0c96c3645"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:35:57.350236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cf60e927-ccf4-44b0-aa32-34b6d4baae10 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.224434 Jul 28 22:35:57.350711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 507/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:57 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:57.369694 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-89aab985-0806-4cd7-9bee-87db7d48e819 req-e35eef2b-750a-4113-b930-f9b7a0474d31 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:57.370149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-89aab985-0806-4cd7-9bee-87db7d48e819 req-e35eef2b-750a-4113-b930-f9b7a0474d31 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:57.384278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-89aab985-0806-4cd7-9bee-87db7d48e819 req-e35eef2b-750a-4113-b930-f9b7a0474d31 service nova] Creating event network-changed:1c06568b-ba30-4d2c-81ad-0bf0c96c3645 for instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee on hv-cinder-85093 Jul 28 22:35:57.389609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-89aab985-0806-4cd7-9bee-87db7d48e819 req-e35eef2b-750a-4113-b930-f9b7a0474d31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063135 Jul 28 22:35:57.390447 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 504/1011] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:57.474424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f55b9d8f-34e9-4b0a-9835-fc7a01123015 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] Calling method '.version_select at 0x7f743c0e3280>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:57.505589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f55b9d8f-34e9-4b0a-9835-fc7a01123015 tempest-TestShelveInstance-2114179531 tempest-TestShelveInstance-2114179531-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285734980" status: 202 len: 0 microversion: 2.1 time: 0.037881 Jul 28 22:35:57.506252 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 508/1012] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Jul 28 22:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285734980 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:35:58.134300 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-df7df176-b7ea-4b1a-bf8a-1cc5affecbff tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c111550>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:58.192478 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-df7df176-b7ea-4b1a-bf8a-1cc5affecbff tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 200 len: 353 microversion: 2.1 time: 0.062732 Jul 28 22:35:58.193235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 505/1013] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:35:58 2022] GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:58.206632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-74b519e5-fffd-4823-8f9f-91a885cc465d tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c11de50>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:58.276312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-74b519e5-fffd-4823-8f9f-91a885cc465d tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 200 len: 353 microversion: 2.1 time: 0.073741 Jul 28 22:35:58.276876 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 509/1014] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:35:58 2022] GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:35:58.296894 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-70aa94cb-7882-48df-93d4-53a2cb99dcd3 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c112430>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:58.373301 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:58.374415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:58.376307 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-70aa94cb-7882-48df-93d4-53a2cb99dcd3 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 202 len: 0 microversion: 2.1 time: 0.083897 Jul 28 22:35:58.378917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 506/1015] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Jul 28 22:35:58 2022] DELETE /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:35:58.388625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4c912f83-2146-4e8c-ae84-162a77fb129e tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c02c0d0>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:58.389710 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:58.390396 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:58.391471 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:58.392216 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:58.456867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4c912f83-2146-4e8c-ae84-162a77fb129e tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 200 len: 352 microversion: 2.1 time: 0.072754 Jul 28 22:35:58.457440 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 507/1016] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:35:58 2022] GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:35:58.624525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:58.649082 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bfd6555c-5747-4ada-b103-275af5274096 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.281366 Jul 28 22:35:58.664843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 510/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:58 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:35:59.472756 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0b40c4e4-8e0c-4c93-9cf2-9651c1e339c2 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Calling method '.version_select at 0x7f743c111e50>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:59.513966 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-0b40c4e4-8e0c-4c93-9cf2-9651c1e339c2 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] HTTP exception thrown: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0b40c4e4-8e0c-4c93-9cf2-9651c1e339c2 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Request method failure captured: Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 HTTP/1.1 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w9MmUhXczt7tjTTSm1hZX239W59HpK2NTmOdVID4dtIlhrzNI1iAmIJtmCOkRwnQhTigqL-jTriF4Kq0RObB5FFauE0jULDrXmLryEPjxbeDMSSkrZcMGQ4gjl3jX_JK9dOODmkxtm9vPNWXWhoMFbHEJ7IC8338xNu2RlhLNnyLZ8 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 3dc1c6397c6a499e989953d4cd8f6764 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-VolumesGetTestJSON-1026126159 Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:35:59.516358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3dc1c6397c6a499e989953d4cd8f6764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3dc1c6397c6a499e989953d4cd8f6764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3dc1c6397c6a499e989953d4cd8f6764"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3dc1c6397c6a499e989953d4cd8f6764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-VolumesGetTestJSON-1026126159 Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 3dc1c6397c6a499e989953d4cd8f6764 Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-VolumesGetTestJSON-1026126159 Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-VolumesGetTestJSON-1026126159-project Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 133c7e259d3140a487a4c7d14c736a67 Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-VolumesGetTestJSON-1026126159-project Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '0ed64a22-0c7e-4fef-b8cb-20776db0fbd3'} Jul 28 22:35:59.517828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. (HTTP 404) (Request-ID: req-6ccd431b-5293-4dde-8076-61055becd1e2) Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:59.519247 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 22:35:59.523117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 22:35:59.524361 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0b40c4e4-8e0c-4c93-9cf2-9651c1e339c2 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] Returning 404 to user: Volume 0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0b40c4e4-8e0c-4c93-9cf2-9651c1e339c2 tempest-VolumesGetTestJSON-1026126159 tempest-VolumesGetTestJSON-1026126159-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3" status: 404 len: 109 microversion: 2.1 time: 0.050586 Jul 28 22:35:59.526687 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 508/1018] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Jul 28 22:35:59 2022] GET /compute/v2.1/os-volumes/0ed64a22-0c7e-4fef-b8cb-20776db0fbd3 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:35:59.677970 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:35:59.679235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:35:59.687345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:59.687345 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:59.688071 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:35:59.688634 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:35:59.964580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:35:59.974452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-3f7c9d04-ff2d-4f42-9a55-e6e5b4ca95d7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.304647 Jul 28 22:35:59.977787 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 511/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:35:59 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:01.001864 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:01.006166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:01.017248 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:01.020614 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:01.025110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:01.027047 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:01.197127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:01.205290 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b08cd504-df49-4617-84e2-585171825603 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.212832 Jul 28 22:36:01.206260 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 509/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:00 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:02.227616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:02.228381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:02.241425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:02.246662 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:02.249652 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:02.250285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:02.740784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:02.751564 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-db83803e-7de7-487f-8149-637e5bf33782 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.527948 Jul 28 22:36:02.769661 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 512/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:02 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:03.797698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:03.797698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:03.797698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:03.801905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:03.802819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:03.803272 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:04.091353 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:04.103171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-fc4ba870-760a-4225-a7c0-74db731b54a1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.328738 Jul 28 22:36:04.103758 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 510/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:03 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:05.126643 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:05.128890 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:05.149594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:05.150051 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:05.151154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:05.151845 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:05.547730 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:05.560363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9621faee-e7da-4a6b-8e63-a98644ab34a4 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.439236 Jul 28 22:36:05.568026 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 513/1023] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:05 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:06.514942 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-a799b362-4e32-4678-9976-c7f24d2afd04 req-d37bc52a-cb91-4202-a63e-61f13b903389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a0bb72-6ab1-4e67-a33f-3f93da40cfee", "name": "network-vif-plugged", "status": "completed", "tag": "1c06568b-ba30-4d2c-81ad-0bf0c96c3645"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:36:06.534399 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-a799b362-4e32-4678-9976-c7f24d2afd04 req-d37bc52a-cb91-4202-a63e-61f13b903389 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:06.534625 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-a799b362-4e32-4678-9976-c7f24d2afd04 req-d37bc52a-cb91-4202-a63e-61f13b903389 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:06.553740 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-a799b362-4e32-4678-9976-c7f24d2afd04 req-d37bc52a-cb91-4202-a63e-61f13b903389 service nova] Creating event network-vif-plugged:1c06568b-ba30-4d2c-81ad-0bf0c96c3645 for instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee on hv-cinder-85093 Jul 28 22:36:06.575011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-a799b362-4e32-4678-9976-c7f24d2afd04 req-d37bc52a-cb91-4202-a63e-61f13b903389 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062159 Jul 28 22:36:06.577990 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 511/1024] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:36:06.588588 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:06.589295 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:06.601735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:06.602757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:06.603998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:06.612550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:06.865192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:06.875209 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-02fd7798-1fe1-4167-8ee5-081a66e5786b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.289595 Jul 28 22:36:06.876477 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 514/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:06 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:07.902672 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:07.903592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:07.924680 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:07.925216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:07.926079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:07.926529 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:08.215637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:08.228855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-af05870b-c092-45c4-97c6-13938dec6438 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1267 microversion: 2.1 time: 0.331091 Jul 28 22:36:08.244338 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 512/1026] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:07 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:09.251794 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:09.253615 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:09.264137 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:09.265151 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:09.267630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:09.270343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:09.533369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:09.562625 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-6c517b30-1dfd-4a22-a4d5-15617e083ec5 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1453 microversion: 2.1 time: 0.313427 Jul 28 22:36:09.566140 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 515/1027] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:09 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1453 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:09.585961 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:36:09.587089 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:36:09.597392 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:09.598432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:09.599551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:09.600238 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:09.839220 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:36:09.852049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-08141be9-46ef-4c08-9596-63b5e07bc225 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1453 microversion: 2.1 time: 0.269249 Jul 28 22:36:09.852049 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 513/1028] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:36:09 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1453 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:36:12.511554 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-3078e8b6-fae6-4813-acbc-d4a4bfae6fff req-da38484b-7389-4cce-8682-46b604624e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a0bb72-6ab1-4e67-a33f-3f93da40cfee", "tag": "1c06568b-ba30-4d2c-81ad-0bf0c96c3645"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:36:12.532856 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3078e8b6-fae6-4813-acbc-d4a4bfae6fff req-da38484b-7389-4cce-8682-46b604624e77 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:36:12.533608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-3078e8b6-fae6-4813-acbc-d4a4bfae6fff req-da38484b-7389-4cce-8682-46b604624e77 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:36:12.548143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-3078e8b6-fae6-4813-acbc-d4a4bfae6fff req-da38484b-7389-4cce-8682-46b604624e77 service nova] Creating event network-changed:1c06568b-ba30-4d2c-81ad-0bf0c96c3645 for instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee on hv-cinder-85093 Jul 28 22:36:12.554031 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-3078e8b6-fae6-4813-acbc-d4a4bfae6fff req-da38484b-7389-4cce-8682-46b604624e77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046135 Jul 28 22:36:12.554892 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 516/1029] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:36:45.440875 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:36:45.441452 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Thu Jul 28 22:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:37:08.518393 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-804350517", "imageRef": "bf06fe38-99bc-46be-9e62-268662767f75", "flavorRef": "452"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:08.527635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=19 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:08.528559 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:08.592360 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] validate_networks() for None {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:37:08.915694 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:37:08.916511 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:37:08.917167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:37:08.917808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:37:08.918479 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:37:08.929888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:08.930576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:08.931535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:08.932151 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:08.950401 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Getting quotas for project 314a6ead5fe74aeda4d817081b9571eb. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:37:08.954649 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Getting quotas for user bb6d5a1ea4f949be98f89a108fa25d53 and project 314a6ead5fe74aeda4d817081b9571eb. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:37:08.969390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:37:08.971703 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf06fe38-99bc-46be-9e62-268662767f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:37:09.028103 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-8ae73ea9-ff53-47e2-8daf-f5d653cbaff0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514230 Jul 28 22:37:09.028743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 514/1030] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:37:09.038993 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:09.040657 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=84 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:09.044977 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-304bbd60-83fa-44d4-ab84-c74b6e3c3862 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:09.046017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-304bbd60-83fa-44d4-ab84-c74b6e3c3862 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:09.110698 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-304bbd60-83fa-44d4-ab84-c74b6e3c3862 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:09.118518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-304bbd60-83fa-44d4-ab84-c74b6e3c3862 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1214 microversion: 2.1 time: 0.081460 Jul 28 22:37:09.119224 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 517/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:09 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:10.141609 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:10.144826 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:10.159622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:10.160959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:10.161982 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:10.162505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:10.248637 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:10.268620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b3bf2da6-4c69-4fbb-ab7d-f1a761b63bf5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1266 microversion: 2.1 time: 0.119510 Jul 28 22:37:10.268620 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 515/1032] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:10 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:10.833613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ce203bfa-ef35-4de0-89c3-aad4a8bc04ca tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'create', calling method: .version_select at 0x7f743c0409d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-843614531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/22HZQY4jrzOOB08KLhXhCwkYRKCfM6c3axe2hUDpgVvm/jUJgait8FVEgvGu4TlYM0hdrw7ViXeF7O7O2i8R1CVxh/39JfRppgX2T0M1Eejb2pos9yfbADiNJcIiesw=="}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:10.852460 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-ce203bfa-ef35-4de0-89c3-aad4a8bc04ca tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Getting quotas for project 651fa66c961b4d07a8fa735e63cdef79. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:37:10.857843 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.quota [None req-ce203bfa-ef35-4de0-89c3-aad4a8bc04ca tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Getting quotas for user 2e64644dc881469e907a6f6669999757 and project 651fa66c961b4d07a8fa735e63cdef79. Resources: {'key_pairs'} {{(pid=118086) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:37:10.882094 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ce203bfa-ef35-4de0-89c3-aad4a8bc04ca tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052527 Jul 28 22:37:10.882691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 518/1033] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Jul 28 22:37:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:37:10.986464 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1071796663", "imageRef": "54a43a5b-6e35-40c6-98a5-1c3d1b7ab796", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-843614531", "networks": [{"uuid": "ff9bd7b7-ec2f-4c9a-9a3a-57f9ab511898"}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:11.047065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] validate_networks() for [('ff9bd7b7-ec2f-4c9a-9a3a-57f9ab511898', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:37:11.293543 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:11.294204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:11.304589 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:11.305042 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:11.305844 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:11.306285 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:11.499017 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:37:11.499536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:37:11.500235 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:37:11.500717 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:37:11.501222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:37:11.512565 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:11.513502 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:11.514616 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:11.515153 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:11.523620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:11.533133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Getting quotas for project 651fa66c961b4d07a8fa735e63cdef79. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:37:11.537853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Getting quotas for user 2e64644dc881469e907a6f6669999757 and project 651fa66c961b4d07a8fa735e63cdef79. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:37:11.538227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-cea4ece0-e59f-448f-b735-5a258fa44ce4 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.252661 Jul 28 22:37:11.539316 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 519/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:11 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:11.559187 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:37:11.561745 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54a43a5b-6e35-40c6-98a5-1c3d1b7ab796',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:37:11.620799 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3f7b9228-5160-4894-b14d-d27184c8816f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638114 Jul 28 22:37:11.621979 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 516/1035] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:37:11.632792 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-95e68a1a-45d9-4933-862f-f761b8a75776 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:11.633742 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-95e68a1a-45d9-4933-862f-f761b8a75776 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:11.711932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-95e68a1a-45d9-4933-862f-f761b8a75776 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:11.719096 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-95e68a1a-45d9-4933-862f-f761b8a75776 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1258 microversion: 2.1 time: 0.090675 Jul 28 22:37:11.720186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 520/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:11 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:12.281110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-edc47345-28d9-4e03-ad63-21b2984eb65d req-61300a4f-81d7-4396-a31c-a262221fc4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c2633c-b31c-406c-b504-796237f19af1", "tag": "f485a406-0a9a-4246-858b-82573aea1aae"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:12.321790 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-edc47345-28d9-4e03-ad63-21b2984eb65d req-61300a4f-81d7-4396-a31c-a262221fc4ff service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:12.322570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-edc47345-28d9-4e03-ad63-21b2984eb65d req-61300a4f-81d7-4396-a31c-a262221fc4ff service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:12.337829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-edc47345-28d9-4e03-ad63-21b2984eb65d req-61300a4f-81d7-4396-a31c-a262221fc4ff service nova] Creating event network-changed:f485a406-0a9a-4246-858b-82573aea1aae for instance b4c2633c-b31c-406c-b504-796237f19af1 on hv-cinder-85093 Jul 28 22:37:12.345827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-edc47345-28d9-4e03-ad63-21b2984eb65d req-61300a4f-81d7-4396-a31c-a262221fc4ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075457 Jul 28 22:37:12.347025 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 517/1037] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:37:12.559570 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:12.560213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:12.568355 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:12.568811 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:12.569613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:12.570060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:12.700965 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:12.709503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-62b2b018-d2eb-4fd6-8743-27c5f513cbca tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.153849 Jul 28 22:37:12.710100 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 521/1038] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:12 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:12.742295 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:12.743006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:12.749293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:12.749916 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:12.750694 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:12.751133 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:12.819239 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:12.834387 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-fbb86651-0830-4fe2-b43e-7d745f321f11 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1310 microversion: 2.1 time: 0.097515 Jul 28 22:37:12.835159 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 518/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:12 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:13.731878 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:13.733385 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:13.741701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:13.742408 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:13.743236 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:13.743834 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:13.856121 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:13.857467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:13.867743 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:13.868432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:13.869819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:13.870668 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:13.903752 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:13.914608 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b9e3c597-e3aa-4120-87ea-e8ad1afc749a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.188219 Jul 28 22:37:13.917952 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 522/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:13 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:14.046260 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:14.054713 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-53487437-26a5-4920-a387-2b3d9e1f4db1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.202622 Jul 28 22:37:14.055293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 519/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:13 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:14.936630 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:14.938333 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:14.946620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:14.947447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:14.948659 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:14.949367 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:15.078425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:15.079685 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:15.089855 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:15.090592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:15.091601 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:15.092368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:15.101264 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:15.110381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c481c896-cbe6-486d-bfe4-75980ac7fa4f tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.177839 Jul 28 22:37:15.110965 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 523/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:14 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:15.248605 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:15.256734 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5aa81384-0f1a-4dd5-bc15-15098dff1292 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.183995 Jul 28 22:37:15.257308 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 520/1043] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:15 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:16.132357 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:16.133020 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:16.140053 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:16.140447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:16.141248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:16.141980 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:16.279213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:16.280449 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:16.288984 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:16.289435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:16.290242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:16.290681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:16.311842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:16.320025 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-8128c7e5-5392-4486-af65-4aed7bb46826 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.192602 Jul 28 22:37:16.320600 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 524/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:16 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:16.443039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:16.450670 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b696de93-0d01-457d-a92c-5c9d747c64de tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.176251 Jul 28 22:37:16.451231 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 521/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:16 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:17.344576 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:17.348033 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:17.360545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:17.361269 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:17.362261 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:17.368920 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:17.472830 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:17.474763 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:17.483473 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:17.494368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:17.495222 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:17.495890 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:17.537446 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:17.559097 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4ebd9890-cc1b-465b-a3bd-8c8c7d3567f2 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.219217 Jul 28 22:37:17.571948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 525/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:17 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:17.612753 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-ad5f79ea-ee9c-410a-8b30-c0994eed786f req-83e87c20-75a2-41dd-87c0-615faa830f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c2633c-b31c-406c-b504-796237f19af1", "name": "network-vif-plugged", "status": "completed", "tag": "f485a406-0a9a-4246-858b-82573aea1aae"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:17.627807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ad5f79ea-ee9c-410a-8b30-c0994eed786f req-83e87c20-75a2-41dd-87c0-615faa830f6a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:17.628782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-ad5f79ea-ee9c-410a-8b30-c0994eed786f req-83e87c20-75a2-41dd-87c0-615faa830f6a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:17.657114 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-ad5f79ea-ee9c-410a-8b30-c0994eed786f req-83e87c20-75a2-41dd-87c0-615faa830f6a service nova] Creating event network-vif-plugged:f485a406-0a9a-4246-858b-82573aea1aae for instance b4c2633c-b31c-406c-b504-796237f19af1 on hv-cinder-85093 Jul 28 22:37:17.665804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-ad5f79ea-ee9c-410a-8b30-c0994eed786f req-83e87c20-75a2-41dd-87c0-615faa830f6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057661 Jul 28 22:37:17.666624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 526/1047] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:37:17.695838 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:17.704117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-4be5dbc4-f697-4049-bd62-8ee5dd193224 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.235561 Jul 28 22:37:17.719368 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 522/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:17 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:18.585279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:18.586021 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:18.592982 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:18.593419 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:18.594225 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:18.594717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:18.730343 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:18.731048 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:18.741626 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:18.744944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:18.745443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:18.746505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:18.747390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:18.750486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-005a17d1-4677-4208-b30b-d4eb43745973 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.169866 Jul 28 22:37:18.751054 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 527/1049] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:18 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:18.890102 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:18.898922 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-a06fdf58-2b5a-49c0-a509-798882be4fdd tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.172754 Jul 28 22:37:18.899433 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 523/1050] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:18 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:19.772833 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:19.773505 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:19.782076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:19.782912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:19.783954 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:19.784613 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:19.920728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:19.921640 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:19.929330 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:19.929811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:19.930585 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:19.930713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:19.931023 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:19.938354 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1fb4b951-6aa3-4f0b-b35d-869bbb6be09a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.170029 Jul 28 22:37:19.939063 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 528/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:19 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:20.089860 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:20.097704 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-42265d11-425b-4609-9126-8de0f148ce75 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.181181 Jul 28 22:37:20.098288 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 524/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:19 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:20.962000 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:20.962624 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:20.969328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:20.969859 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:20.970664 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:20.971098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:21.106929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:21.117415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-23774553-8c82-4198-ab31-4879cb57e010 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.159743 Jul 28 22:37:21.118427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 529/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:20 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:21.119630 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:21.120257 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:21.126933 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:21.127698 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:21.128835 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:21.129347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:21.277369 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:21.285006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e2b3065f-907c-4aa1-a8b4-c2478e56d792 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.169552 Jul 28 22:37:21.285811 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 525/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:21 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:22.142901 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:22.143518 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:22.145486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=8 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:22.152115 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:22.152569 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:22.153343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:22.153807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:22.280235 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:22.287915 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-52062053-2d39-474c-9033-c35d60710f7a tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.148821 Jul 28 22:37:22.288415 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 530/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:22 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:22.306510 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:22.307241 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:22.309188 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=4 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:22.310037 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=12 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:22.316570 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:22.317061 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:22.317895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:22.318956 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:22.450585 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:22.458014 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2a8aad28-0ba5-439a-bc35-90c0cbce89f9 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.155303 Jul 28 22:37:22.458593 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 526/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:22 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:23.309397 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:23.310243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:23.316715 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:23.317174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:23.318076 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:23.319154 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:23.455511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:23.463110 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ca635696-f601-4810-8783-abb883a283c5 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1314 microversion: 2.1 time: 0.157635 Jul 28 22:37:23.463738 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 531/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:23 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:23.479071 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:23.480216 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:23.486700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:23.487148 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:23.487905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:23.488337 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:23.638326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:23.647768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-46d29118-3f33-44a7-b792-54e3a10921c8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.172504 Jul 28 22:37:23.648372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 527/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:23 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:23.935361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-f0f52a25-71d5-4455-9364-46234b641141 req-1bc8f9cb-bce4-40dc-93fa-d6d7bca0d11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:23.946548 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f0f52a25-71d5-4455-9364-46234b641141 req-1bc8f9cb-bce4-40dc-93fa-d6d7bca0d11e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:23.946997 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f0f52a25-71d5-4455-9364-46234b641141 req-1bc8f9cb-bce4-40dc-93fa-d6d7bca0d11e service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:23.959961 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-f0f52a25-71d5-4455-9364-46234b641141 req-1bc8f9cb-bce4-40dc-93fa-d6d7bca0d11e service nova] Creating event network-changed:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:37:23.964824 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-f0f52a25-71d5-4455-9364-46234b641141 req-1bc8f9cb-bce4-40dc-93fa-d6d7bca0d11e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034487 Jul 28 22:37:23.965425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 532/1059] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:37:24.484033 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:24.484762 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:24.491805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.492253 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.493039 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.493458 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.629081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:24.637869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-dce2721c-dde1-489a-9924-b0802ba3ae7c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1463 microversion: 2.1 time: 0.157785 Jul 28 22:37:24.638443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 528/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:24 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:24.670319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:24.671170 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:24.679256 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.679713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.680498 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.680936 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.684869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:24.685372 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:24.692229 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.692669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.693487 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.693951 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.729245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:37:24.817435 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-ad920077-ac51-4cb7-8d2d-6b64c9090658 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 204 len: 0 microversion: 2.1 time: 0.136564 Jul 28 22:37:24.819819 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 529/1061] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:37:24 2022] DELETE /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:37:24.830425 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:24.831010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:24.831535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:24.838722 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.839418 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.840262 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:24.840843 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:24.840959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ef23290b-febf-4d24-b4f5-f69220671935 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.175105 Jul 28 22:37:24.841827 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 533/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:24 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:24.974240 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:24.978808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:24.983692 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-7ef74fdc-c923-4564-8fb6-70139550798c tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1469 microversion: 2.1 time: 0.158850 Jul 28 22:37:24.984293 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 530/1063] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:24 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:25.863602 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:25.864200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:25.870919 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:25.871373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:25.872159 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:25.872598 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:26.008154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:26.009446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:26.023328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:26.023783 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:26.024567 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:26.025004 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:26.043603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:26.057631 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-96b0f4e9-c574-4653-8e11-87964b3735e5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.197902 Jul 28 22:37:26.058305 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 534/1064] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:25 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:26.188355 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:26.196727 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-09d119b3-6755-4c67-ad75-4480bca30bc0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1469 microversion: 2.1 time: 0.195073 Jul 28 22:37:26.197312 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 531/1065] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:26 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:26.943017 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-d2db5fbc-21eb-4f77-9474-3204f80c63db req-70fb688b-7991-42c0-851a-7815f92f8cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c2633c-b31c-406c-b504-796237f19af1", "name": "network-vif-deleted", "tag": "f485a406-0a9a-4246-858b-82573aea1aae"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:26.953312 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d2db5fbc-21eb-4f77-9474-3204f80c63db req-70fb688b-7991-42c0-851a-7815f92f8cde service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:26.953805 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d2db5fbc-21eb-4f77-9474-3204f80c63db req-70fb688b-7991-42c0-851a-7815f92f8cde service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:26.966298 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-d2db5fbc-21eb-4f77-9474-3204f80c63db req-70fb688b-7991-42c0-851a-7815f92f8cde service nova] Creating event network-vif-deleted:f485a406-0a9a-4246-858b-82573aea1aae for instance b4c2633c-b31c-406c-b504-796237f19af1 on hv-cinder-85093 Jul 28 22:37:26.971299 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-d2db5fbc-21eb-4f77-9474-3204f80c63db req-70fb688b-7991-42c0-851a-7815f92f8cde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Jul 28 22:37:26.971908 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 535/1066] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:37:27.082705 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:27.083311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:27.090397 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:27.090842 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:27.091597 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:27.092027 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:27.220907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:27.221306 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:27.221785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:27.229271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:27.229537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2ace70ec-7d68-4e04-92e7-cfd10ba77c4e tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.150663 Jul 28 22:37:27.229895 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:27.230126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 532/1067] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:27 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:27.230807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:27.231320 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:27.297832 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6d5a1ea4f949be98f89a108fa25d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314a6ead5fe74aeda4d817081b9571eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:27.306028 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-91ee48df-156f-481b-9c8c-22251808f045 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 200 len: 1427 microversion: 2.1 time: 0.089469 Jul 28 22:37:27.306594 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 536/1068] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:27 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:28.250315 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:28.250884 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:28.258521 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:28.258976 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:28.259739 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:28.260175 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:28.327272 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:28.327879 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] [instance: b4c2633c-b31c-406c-b504-796237f19af1] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:28.335209 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:28.335725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:28.337011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:28.337011 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:28.350771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] HTTP exception thrown: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Request method failure captured: Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 HTTP/1.1 Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w-Si-1QJhQv6AqNFIQpI7FajVvdYSDtsH-N3tRsmJWzELhulVxOBmepA8mSCT9FSsfdf2yxUXCkmfqCXzj_DkAIjwlcl6zpysD-ODNl1O2xomECK8x8sEsfVaY0oSIyz_KsOuRXqeq9gsPaxgEi2VgR1JWEtTCxH_WVEBXnWdJ11Bg Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 314a6ead5fe74aeda4d817081b9571eb Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-VolumesNegativeTest-859393151 Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:37:28.352443 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/314a6ead5fe74aeda4d817081b9571eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/314a6ead5fe74aeda4d817081b9571eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/314a6ead5fe74aeda4d817081b9571eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_314a6ead5fe74aeda4d817081b9571eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-VolumesNegativeTest-859393151 Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 314a6ead5fe74aeda4d817081b9571eb Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-VolumesNegativeTest-859393151 Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-VolumesNegativeTest-859393151-project Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: bb6d5a1ea4f949be98f89a108fa25d53 Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-VolumesNegativeTest-859393151-project Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. Jul 28 22:37:28.354035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': 'b4c2633c-b31c-406c-b504-796237f19af1'} Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:37:28.355501 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. Jul 28 22:37:28.356902 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:37:28.358219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] Returning 404 to user: Instance b4c2633c-b31c-406c-b504-796237f19af1 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:37:28.358219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-61699d02-7fa4-48e3-af19-673a86c9ccf0 tempest-VolumesNegativeTest-859393151 tempest-VolumesNegativeTest-859393151-project] 10.222.0.39 "GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1" status: 404 len: 111 microversion: 2.1 time: 0.030454 Jul 28 22:37:28.358219 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 537/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:28 2022] GET /compute/v2.1/servers/b4c2633c-b31c-406c-b504-796237f19af1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:37:28.392138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:28.399906 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f16b924a-a6f6-4bb1-8940-9a48193ea5c4 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.153535 Jul 28 22:37:28.400483 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 533/1070] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:28 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:29.420375 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:29.420987 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:29.427875 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:29.428590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:29.429425 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:29.429889 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:29.576554 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:29.586658 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0305d7aa-b0fa-4f0b-a8d5-3198ed493bbc tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.170283 Jul 28 22:37:29.587672 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 538/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:29 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:30.608540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:30.609149 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:30.617710 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:30.618161 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:30.622026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:30.622026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:30.759973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:30.770454 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-c31521b3-5ef6-4ae8-95a2-1d969aca0d01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.165667 Jul 28 22:37:30.771040 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 534/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:30 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:31.528904 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-1bbbe7b7-4d00-4bcf-b201-58e227fd1767 req-5328d75a-4066-4b35-bd18-e181eb5273a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "name": "network-vif-plugged", "status": "completed", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:31.540857 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1bbbe7b7-4d00-4bcf-b201-58e227fd1767 req-5328d75a-4066-4b35-bd18-e181eb5273a1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:31.541303 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-1bbbe7b7-4d00-4bcf-b201-58e227fd1767 req-5328d75a-4066-4b35-bd18-e181eb5273a1 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:31.545271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=100 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:31.555921 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-1bbbe7b7-4d00-4bcf-b201-58e227fd1767 req-5328d75a-4066-4b35-bd18-e181eb5273a1 service nova] Creating event network-vif-plugged:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:37:31.560689 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-1bbbe7b7-4d00-4bcf-b201-58e227fd1767 req-5328d75a-4066-4b35-bd18-e181eb5273a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035519 Jul 28 22:37:31.561271 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 539/1073] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:37:31.793155 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:31.793795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:31.800314 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:31.800761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:31.801555 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:31.801990 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:31.932327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:31.939795 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6210fec3-2f78-4ebb-80e1-fc31e0d4cfb2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1358 microversion: 2.1 time: 0.150558 Jul 28 22:37:31.940390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 535/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:31 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:32.962437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:32.963139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:32.969339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:32.969873 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:32.970648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:32.971089 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.097777 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:33.105774 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-e9e85238-6479-4855-a201-2e6c7b980f6d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1548 microversion: 2.1 time: 0.148729 Jul 28 22:37:33.106336 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 540/1075] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:32 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:37:33.125929 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:33.126543 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:33.133732 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.134124 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.134889 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.135327 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.267829 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:33.277110 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-2d9da03a-d7dd-4a69-954d-fea745f0bf84 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1548 microversion: 2.1 time: 0.155017 Jul 28 22:37:33.277957 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 536/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:33 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:33.298205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:33.302932 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:33.304250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Searching by: {'deleted': False, 'project_id': '651fa66c961b4d07a8fa735e63cdef79'} {{(pid=118086) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 28 22:37:33.310907 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.311360 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.312163 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.312599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.406373 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.multi_cell_list [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118086) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 22:37:33.504599 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bc21a6e5-c239-4336-861a-46c3eccf8108 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210097 Jul 28 22:37:33.505160 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 541/1077] 10.222.0.39 () {58 vars in 1125 bytes} [Thu Jul 28 22:37:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:37:33.517545 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:33.518163 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:33.524849 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.525297 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.526117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:33.526558 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:33.652655 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:33.660319 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-39706eb4-56bd-499b-9ad9-24285b527d5d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1548 microversion: 2.1 time: 0.146692 Jul 28 22:37:33.660835 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 537/1078] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:33 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:35.372937 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7cd4c71-cbc7-4661-a771-cae24b462442"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:35.375281 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:35.382034 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:35.382482 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:35.383242 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:35.383681 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:35.614391 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-41ae3ec3-1dbb-4488-8489-17dd9ac522f3 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245139 Jul 28 22:37:35.615003 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 542/1079] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Jul 28 22:37:35 2022] POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:37:42.137126 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:42.137767 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:42.139759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:42.145913 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:42.146867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:42.147654 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:42.148085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:42.277136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:42.285085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cb3402b6-9628-4e32-93da-6cad1b5e7a6b tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1594 microversion: 2.1 time: 0.151932 Jul 28 22:37:42.285673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 538/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:42 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:44.216525 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell0:SELECT=2 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:44.220751 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-f27f1464-ad8a-4270-ab18-03d0b5e0e62d req-aa73b5bb-00ec-4229-a1c2-415cd404741f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:44.226470 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:37:44.233250 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f27f1464-ad8a-4270-ab18-03d0b5e0e62d req-aa73b5bb-00ec-4229-a1c2-415cd404741f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:44.233727 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-f27f1464-ad8a-4270-ab18-03d0b5e0e62d req-aa73b5bb-00ec-4229-a1c2-415cd404741f service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:44.246497 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-f27f1464-ad8a-4270-ab18-03d0b5e0e62d req-aa73b5bb-00ec-4229-a1c2-415cd404741f service nova] Creating event network-changed:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:37:44.251802 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-f27f1464-ad8a-4270-ab18-03d0b5e0e62d req-aa73b5bb-00ec-4229-a1c2-415cd404741f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036533 Jul 28 22:37:44.252722 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 543/1081] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:37:45.375761 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1355070338"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:45.376394 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:45.384035 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:45.384584 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:45.385438 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:45.386075 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:45.516111 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.network.security_group_api [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Adding security group d2612d83-b87f-4234-a7d5-8568fe32c626 to port 5773b105-f56f-4c3a-b6a5-26e99920cf83 Jul 28 22:37:45.913268 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-78950ada-56f5-43f4-a877-8a51dce5e0b1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.540442 Jul 28 22:37:45.913798 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 539/1082] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:37:45 2022] POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:37:45.926437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:37:45.928288 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:37:45.941829 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:45.942795 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:45.944322 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:45.945046 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:46.113177 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:37:46.122733 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-adc9e32f-614e-4858-a19c-2fe5b734b0e1 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1760 microversion: 2.1 time: 0.203947 Jul 28 22:37:46.123747 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 544/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:37:45 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1760 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:37:46.266886 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-e77e5845-b592-4c2c-86d7-338a24ed6470 req-9965bdab-ee82-4e80-ad10-15968c7ccade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:37:46.276441 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-e77e5845-b592-4c2c-86d7-338a24ed6470 req-9965bdab-ee82-4e80-ad10-15968c7ccade service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:37:46.276880 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-e77e5845-b592-4c2c-86d7-338a24ed6470 req-9965bdab-ee82-4e80-ad10-15968c7ccade service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:37:46.288535 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-e77e5845-b592-4c2c-86d7-338a24ed6470 req-9965bdab-ee82-4e80-ad10-15968c7ccade service nova] Creating event network-changed:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:37:46.293808 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-e77e5845-b592-4c2c-86d7-338a24ed6470 req-9965bdab-ee82-4e80-ad10-15968c7ccade service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030484 Jul 28 22:37:46.294474 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 540/1084] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:38:09.919964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:38:09.922486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:09.925282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=3 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:09.925952 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:09.933287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:09.933779 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:09.934551 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:09.934995 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:10.007720 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-f47e4be7-2bad-4a24-b8e1-54c15ef09848 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.091663 Jul 28 22:38:10.008609 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 545/1085] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:38:09 2022] POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:38:10.014497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=5 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:10.015242 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=54 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:10.019255 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:10.020101 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:10.027590 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:10.028065 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:10.028861 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:10.029334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:10.312875 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:10.321334 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5764fe47-e2c6-4038-9948-3435d9be755a tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1752 microversion: 2.1 time: 0.308403 Jul 28 22:38:10.322258 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 541/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:10 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1752 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:11.344070 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:11.344766 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:11.351016 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:11.351500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:11.352254 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:11.352686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:11.547230 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:11.555757 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-136b8d50-ccb9-4088-b90e-0c0d6451c798 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1752 microversion: 2.1 time: 0.216424 Jul 28 22:38:11.556328 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 546/1087] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:11 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:12.577476 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:12.578030 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:12.584726 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:12.585170 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:12.586051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:12.586443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:12.744915 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:12.752987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5e23e69e-1275-44a7-9e3d-065ab2d0f62c tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1752 microversion: 2.1 time: 0.179443 Jul 28 22:38:12.753828 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 542/1088] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:12 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:13.774996 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:13.775610 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:13.781927 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:13.782378 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:13.783143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:13.783581 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:13.925422 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:13.934127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9b668fef-96ab-46b3-8454-d9c486d56b07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.163148 Jul 28 22:38:13.934687 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 547/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:13 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:14.956520 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:14.957138 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:14.963719 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:14.964179 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:14.964950 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:14.965390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:15.121005 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:15.129237 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e372ff33-c1e6-4317-8fb5-f72b77909e26 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.176614 Jul 28 22:38:15.129853 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 543/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:14 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:15.875888 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:38:15.876142 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Thu Jul 28 22:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:38:16.151737 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:16.152259 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:16.158835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:16.159282 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:16.160035 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:16.160466 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:16.302650 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:16.311851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-ab8d452b-bbd6-4ce5-b1a6-409682eeb0d6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.164695 Jul 28 22:38:16.312424 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 548/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:16 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:16.679669 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-43640475", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305921694", "security_groups": [{"name": "tempest-secgroup-smoke-1337180336"}], "block_device_mapping_v2": [{"uuid": "c1a3ca70-20e5-4f0d-a323-43512de95dd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e"}]}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:38:16.793885 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.network.neutron [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] validate_networks() for [('ff9e5fcd-5d02-4f4d-b9fb-04bc31c0477e', None, None, None, None, None)] {{(pid=118085) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 22:38:17.156789 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 22:38:17.157214 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image limits 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 22:38:17.157718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Flavor pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 22:38:17.158154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Image pref 0:0:0 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 22:38:17.158569 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.virt.hardware [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 22:38:17.168573 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:17.168958 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:17.169801 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:17.170244 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:17.186991 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 22:38:17.191019 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.quota [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Getting quotas for user 32eadc02f9224eb28303aab25506ef2a and project 862a3f47ebe842fb8c5fbd4ef08f0b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=118085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 22:38:17.247612 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Going to run 1 instances... {{(pid=118085) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 28 22:38:17.249718 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1a3ca70-20e5-4f0d-a323-43512de95dd7',volume_size=None,volume_type=None)] {{(pid=118085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 28 22:38:17.333797 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:17.334412 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:17.341452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:17.341943 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:17.342735 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:17.343173 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:17.376031 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-03881abb-db96-4cec-8c33-e9eaf776843b tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700150 Jul 28 22:38:17.376832 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 544/1092] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Jul 28 22:38:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 22:38:17.387847 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-236bfd7d-2962-4a0a-bed0-038aa3697a8a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:17.388446 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-236bfd7d-2962-4a0a-bed0-038aa3697a8a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:17.456859 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-236bfd7d-2962-4a0a-bed0-038aa3697a8a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:17.467517 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-236bfd7d-2962-4a0a-bed0-038aa3697a8a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1093 microversion: 2.1 time: 0.083382 Jul 28 22:38:17.468592 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 545/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:17 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:17.529067 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:17.537429 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-b39e44d3-01f5-48f0-809a-0fab92cfbeb8 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.207491 Jul 28 22:38:17.538015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 549/1094] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:17 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:38:18.488493 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:18.489107 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:18.497008 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:18.497836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:18.498316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:18.498744 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:18.560202 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:18.560926 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:18.566917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:18.579213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3823a314-9d81-4712-b85c-6226adb19af0 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1209 microversion: 2.1 time: 0.094833 Jul 28 22:38:18.579805 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 546/1095] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:18 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:18.588192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:18.588192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:18.588192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:18.588192 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:18.728693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:18.736673 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0527ffea-1f08-4b5c-a39a-f60f834228d2 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.181849 Jul 28 22:38:18.737243 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 550/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:18 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:38:19.606667 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:19.609700 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:19.616818 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:19.617311 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:19.618854 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:19.619458 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:19.759957 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:19.760846 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:19.770294 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:19.770946 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:19.771883 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:19.772098 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:19.772807 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:19.783571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3ac14761-185c-4e0e-9176-2ce888100bbd tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.186448 Jul 28 22:38:19.784534 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 547/1097] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:19 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:19.821615 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-fd031e82-f8e6-434c-9207-43a7a9651dd1 req-e4760984-9428-4e88-b95b-6be64027ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e", "tag": "63c599f6-5106-4ad6-95ed-4585cd24b502"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:38:19.841184 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-fd031e82-f8e6-434c-9207-43a7a9651dd1 req-e4760984-9428-4e88-b95b-6be64027ae98 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:19.841607 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-fd031e82-f8e6-434c-9207-43a7a9651dd1 req-e4760984-9428-4e88-b95b-6be64027ae98 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:19.855081 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-fd031e82-f8e6-434c-9207-43a7a9651dd1 req-e4760984-9428-4e88-b95b-6be64027ae98 service nova] Creating event network-changed:63c599f6-5106-4ad6-95ed-4585cd24b502 for instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e on hv-cinder-85093 Jul 28 22:38:19.859994 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-fd031e82-f8e6-434c-9207-43a7a9651dd1 req-e4760984-9428-4e88-b95b-6be64027ae98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042737 Jul 28 22:38:19.861483 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 548/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:38:19.968319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:19.979319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-323cb57f-d288-4fd8-acca-729a6315f2b5 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.224237 Jul 28 22:38:19.979914 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 551/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:19 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:38:20.808852 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:20.809611 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:20.815892 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:20.816347 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:20.817122 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:20.817576 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:20.954848 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:20.962636 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-f286d8b7-7f52-4a05-a42d-59dfd19b280e tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.159234 Jul 28 22:38:20.963213 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 549/1100] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:20 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:21.001274 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:21.001941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:21.009231 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:21.009714 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:21.010477 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:21.010938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:21.160237 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:21.168478 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-738b4ff9-0b47-4f4d-83fc-1c3ecb680de6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.171011 Jul 28 22:38:21.169038 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 552/1101] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:20 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:21.983171 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:21.983810 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:21.990287 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:21.990752 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:21.991505 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:21.991954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:22.121099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:22.128519 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-3fb2758c-ebde-4e5c-9a8d-abddfca3ffa7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.149278 Jul 28 22:38:22.129326 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 550/1102] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:21 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:22.190346 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:22.190955 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:22.198143 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:22.198586 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:22.199342 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:22.199775 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:22.340204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:22.348111 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-14508b48-4d2e-4e8c-88be-5c1893e5cb07 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.161577 Jul 28 22:38:22.348665 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 553/1103] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:22 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:23.150849 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:23.151467 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:23.158127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:23.158585 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:23.159357 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:23.159797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:23.289232 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:23.297277 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b100331d-ff76-4b6b-9254-ec31ea9b8296 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.151020 Jul 28 22:38:23.297867 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 551/1104] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:23 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:23.369079 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:23.369717 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:23.376185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:23.376628 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:23.377381 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:23.377840 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:23.519755 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:38:23.520010 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 (ip 10.222.0.39) !!! Jul 28 22:38:23.529555 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:23.538127 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9a738010-f9e7-47fe-a4b4-fac0815137a6 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1757 microversion: 2.1 time: 0.173114 Jul 28 22:38:23.538756 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 554/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:23 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 22:38:24.318136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:24.318774 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:24.325927 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:24.326316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:24.327079 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:24.327516 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:24.472125 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:24.480193 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-0304f47c-9340-47da-adb5-4cb947ce541d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.165943 Jul 28 22:38:24.480756 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 552/1106] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:24 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:24.560711 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:24.561372 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:24.567913 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:24.568363 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:24.569130 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:24.569580 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:24.714629 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:24.723539 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-bec6512a-4e31-46c7-ada1-cf47c3823e2f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1760 microversion: 2.1 time: 0.166680 Jul 28 22:38:24.724120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 555/1107] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:24 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:25.501285 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:25.501868 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:25.509157 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:25.509628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:25.510396 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:25.510836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:25.645622 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:25.653797 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-26cf760d-e7de-4cae-80ed-8a6f7f95be29 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.156382 Jul 28 22:38:25.654362 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 553/1108] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:25 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:26.674828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:26.675437 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:26.682492 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:26.682937 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:26.683707 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:26.684174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:26.821248 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:26.829206 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d774a595-75ea-4581-9fa0-a900d5131ed1 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.158199 Jul 28 22:38:26.829801 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 556/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:26 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:27.850052 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:27.850666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:27.854540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=2 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:27.855451 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell0:SELECT=8 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:38:27.862471 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:27.863044 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:27.863973 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:27.864507 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:28.027302 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:28.035316 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-fb78a39b-e92a-4d9c-a18a-5dc65e812938 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.189051 Jul 28 22:38:28.036221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 554/1110] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:27 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:29.059849 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:29.060446 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:29.067276 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:29.067724 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:29.068480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:29.068912 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:29.200185 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:29.207648 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-4a80d722-15de-4fd9-81c9-a7bab9d1fc0d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.151919 Jul 28 22:38:29.208202 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 557/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:29 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:29.862069 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-bdc38c3a-bc21-43b4-b664-f62352ccd762 req-3423000d-01c2-4995-9038-4a26b5372ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e", "name": "network-vif-plugged", "status": "completed", "tag": "63c599f6-5106-4ad6-95ed-4585cd24b502"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:38:29.873959 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-bdc38c3a-bc21-43b4-b664-f62352ccd762 req-3423000d-01c2-4995-9038-4a26b5372ddf service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:29.875575 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-bdc38c3a-bc21-43b4-b664-f62352ccd762 req-3423000d-01c2-4995-9038-4a26b5372ddf service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:29.886666 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-bdc38c3a-bc21-43b4-b664-f62352ccd762 req-3423000d-01c2-4995-9038-4a26b5372ddf service nova] Creating event network-vif-plugged:63c599f6-5106-4ad6-95ed-4585cd24b502 for instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e on hv-cinder-85093 Jul 28 22:38:29.891831 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-bdc38c3a-bc21-43b4-b664-f62352ccd762 req-3423000d-01c2-4995-9038-4a26b5372ddf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Jul 28 22:38:29.892395 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 555/1112] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:38:30.229683 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:30.230617 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:30.237502 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:30.237978 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:30.238734 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:30.239166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:30.371519 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:30.379297 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-9d6e24f2-24c0-4d42-91f3-aecceb5a6b02 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.154091 Jul 28 22:38:30.379866 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 558/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:30 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:31.401245 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:31.401970 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:31.408243 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:31.408628 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:31.409381 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:31.409839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:31.543673 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:31.551386 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-b7113b4f-49b3-4ec0-ac02-17858072f0ab tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1265 microversion: 2.1 time: 0.154840 Jul 28 22:38:31.552099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 556/1114] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:31 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:32.573047 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:32.573697 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:32.580200 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:32.580657 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:32.581427 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:32.581898 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:32.711358 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:32.719506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-c2afd611-be1f-4f1b-8136-d986fc0e27df tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1451 microversion: 2.1 time: 0.150902 Jul 28 22:38:32.720075 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 559/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:32 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:32.739358 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:38:32.739977 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:38:32.746863 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:32.747313 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:32.748072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:32.748504 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:32.881082 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:38:32.889844 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cc77372b-0660-45e4-a5ad-99fb97bb4011 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1451 microversion: 2.1 time: 0.154248 Jul 28 22:38:32.890406 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 557/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:38:32 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:38:34.568447 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-5f37a885-99f8-494d-b9ce-20deb1a8102e req-24cc694c-3d88-42f3-906d-8a7366f32b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e", "tag": "63c599f6-5106-4ad6-95ed-4585cd24b502"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:38:34.580445 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-5f37a885-99f8-494d-b9ce-20deb1a8102e req-24cc694c-3d88-42f3-906d-8a7366f32b74 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:38:34.580893 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-5f37a885-99f8-494d-b9ce-20deb1a8102e req-24cc694c-3d88-42f3-906d-8a7366f32b74 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:38:34.592174 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-5f37a885-99f8-494d-b9ce-20deb1a8102e req-24cc694c-3d88-42f3-906d-8a7366f32b74 service nova] Creating event network-changed:63c599f6-5106-4ad6-95ed-4585cd24b502 for instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e on hv-cinder-85093 Jul 28 22:38:34.597520 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-5f37a885-99f8-494d-b9ce-20deb1a8102e req-24cc694c-3d88-42f3-906d-8a7366f32b74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 Jul 28 22:38:34.598213 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 560/1117] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:39:00.049194 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1355070338"}} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:39:00.049836 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:00.051924 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:39:00.052728 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=84 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:39:00.059591 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:00.060072 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:00.060839 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:00.061278 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:00.187879 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.network.security_group_api [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Removing security group d2612d83-b87f-4234-a7d5-8568fe32c626 from port 5773b105-f56f-4c3a-b6a5-26e99920cf83 Jul 28 22:39:00.518815 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-05016ea0-4ae8-4d74-b4ff-b22144d53b24 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.473753 Jul 28 22:39:00.519621 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 558/1118] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Jul 28 22:39:00 2022] POST /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:39:00.525343 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=32 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:39:00.526620 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:39:00.614696 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-dd7fedd0-d69f-4469-97c2-426eaa4f91bf req-bf061c0e-f8c2-468e-b15d-c758711bac9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:39:00.627484 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-dd7fedd0-d69f-4469-97c2-426eaa4f91bf req-bf061c0e-f8c2-468e-b15d-c758711bac9d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:00.628616 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-dd7fedd0-d69f-4469-97c2-426eaa4f91bf req-bf061c0e-f8c2-468e-b15d-c758711bac9d service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:00.644835 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-dd7fedd0-d69f-4469-97c2-426eaa4f91bf req-bf061c0e-f8c2-468e-b15d-c758711bac9d service nova] Creating event network-changed:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:39:00.651369 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-dd7fedd0-d69f-4469-97c2-426eaa4f91bf req-bf061c0e-f8c2-468e-b15d-c758711bac9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127916 Jul 28 22:39:00.652249 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 561/1119] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:39:01.863127 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:01.863695 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:01.870419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:01.870866 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:01.871619 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:01.872051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:01.953000 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.objects.instance [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lazy-loading 'services' on Instance uuid dd665065-91f7-40eb-a474-2f0b80ffa9f5 {{(pid=118085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 22:39:02.027936 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-cc124886-4d9a-404a-820c-620183188f01 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments/d7cd4c71-cbc7-4661-a771-cae24b462442" status: 202 len: 0 microversion: 2.1 time: 0.169035 Jul 28 22:39:02.028648 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 559/1120] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:39:01 2022] DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments/d7cd4c71-cbc7-4661-a771-cae24b462442 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:39:02.039506 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:02.043512 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:02.050530 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:02.051204 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:02.052172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:02.052683 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:02.083929 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-63b1694f-4a84-42e7-8980-1d31c416f6f0 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050390 Jul 28 22:39:02.084674 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 562/1121] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:39:02 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:39:02.668058 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-2f10ebf6-3fd2-44ed-ab6c-93e3236b44d5 req-281023c3-c55a-480a-817c-4abc5e995086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:39:02.678099 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-2f10ebf6-3fd2-44ed-ab6c-93e3236b44d5 req-281023c3-c55a-480a-817c-4abc5e995086 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:02.678551 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-2f10ebf6-3fd2-44ed-ab6c-93e3236b44d5 req-281023c3-c55a-480a-817c-4abc5e995086 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:02.691064 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-2f10ebf6-3fd2-44ed-ab6c-93e3236b44d5 req-281023c3-c55a-480a-817c-4abc5e995086 service nova] Creating event network-changed:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:39:02.696112 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-2f10ebf6-3fd2-44ed-ab6c-93e3236b44d5 req-281023c3-c55a-480a-817c-4abc5e995086 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 Jul 28 22:39:02.697692 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 560/1122] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:39:03.097002 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:03.099172 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:03.106828 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:03.107279 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:03.108366 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:03.108804 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:03.139144 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1a9cc2e9-f090-4ac9-ad73-ddf7a182a27d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046617 Jul 28 22:39:03.139632 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 563/1123] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Jul 28 22:39:03 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 22:39:03.151167 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:03.151776 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:03.158631 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:03.159154 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:03.160034 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:03.160561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:03.420536 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] HTTP exception thrown: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 is not attached to volume d7cd4c71-cbc7-4661-a771-cae24b462442 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Request method failure captured: Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments/d7cd4c71-cbc7-4661-a771-cae24b462442 HTTP/1.1 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w-GyTmwityMbZg_T40Ph6TqZQcpQjxspEcYYn3W_LEGFnYZquaMqgtiaUk73F6cE5LEUCnAMxX1FGbClXCCm9F40cWF0unvW2fkoCNej5TxIb42MGPxt6TBUeo5gARRz7cIcZ3bxQqr2sMYh_DinKAtVxtBLRujoesJ8JIxaHPxi5E Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 651fa66c961b4d07a8fa735e63cdef79 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:39:03.422981 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 651fa66c961b4d07a8fa735e63cdef79 Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-TestMinimumBasicScenario-884147374-project Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 2e64644dc881469e907a6f6669999757 Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-TestMinimumBasicScenario-884147374-project Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:39:03.424775 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 is not attached to volume d7cd4c71-cbc7-4661-a771-cae24b462442 Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'server_id': 'dd665065-91f7-40eb-a474-2f0b80ffa9f5', 'id': 'd7cd4c71-cbc7-4661-a771-cae24b462442'} Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7cd4c71-cbc7-4661-a771-cae24b462442. Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:39:03.425626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 is not attached to volume d7cd4c71-cbc7-4661-a771-cae24b462442 Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 is not attached to volume d7cd4c71-cbc7-4661-a771-cae24b462442 Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:03.426969 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Returning 404 to user: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 is not attached to volume d7cd4c71-cbc7-4661-a771-cae24b462442 {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:39:03.427995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-16133448-3fe0-41a5-acd4-003611f7040f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments/d7cd4c71-cbc7-4661-a771-cae24b462442" status: 404 len: 154 microversion: 2.1 time: 0.278183 Jul 28 22:39:03.427995 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 561/1124] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Jul 28 22:39:03 2022] DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5/os-volume_attachments/d7cd4c71-cbc7-4661-a771-cae24b462442 => generated 154 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:39:04.562006 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:04.562495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:04.568959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:04.569420 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:04.570221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:04.570663 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:04.596045 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Going to try to terminate instance {{(pid=118086) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:39:04.667465 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-12be83fa-bb25-448d-a4e0-8c6a2f678c9f tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 204 len: 0 microversion: 2.1 time: 0.109071 Jul 28 22:39:04.668158 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 564/1125] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:39:04 2022] DELETE /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:39:04.678443 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:04.679416 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:04.686912 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:04.687359 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:04.688117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:04.688547 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:04.817166 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:39:04.825060 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5fca63ef-6f2a-4ee0-a54a-a7efb1b33034 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1554 microversion: 2.1 time: 0.152688 Jul 28 22:39:04.825633 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 562/1126] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:39:04 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:39:05.846785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:05.847491 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:05.854225 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:05.854734 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:05.855500 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:05.856135 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:05.983951 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:39:05.991435 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-04795cec-bb46-40f7-b2b2-d247bf9c473d tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1554 microversion: 2.1 time: 0.148955 Jul 28 22:39:05.992005 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 565/1127] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:39:05 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:39:07.015011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:07.015626 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:07.022895 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:07.023376 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:07.024153 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:07.026759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:07.104608 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e64644dc881469e907a6f6669999757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '651fa66c961b4d07a8fa735e63cdef79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:39:07.112451 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5489527c-461c-45b9-95c5-a303c70cf711 tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 200 len: 1512 microversion: 2.1 time: 0.101375 Jul 28 22:39:07.113026 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 563/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:39:07 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 1512 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:39:07.173603 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-8281ef66-cd01-4689-b892-8115531e324e req-677174d2-42ff-4e26-bcfc-a848e97999cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd665065-91f7-40eb-a474-2f0b80ffa9f5", "name": "network-vif-deleted", "tag": "5773b105-f56f-4c3a-b6a5-26e99920cf83"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:39:07.183060 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-8281ef66-cd01-4689-b892-8115531e324e req-677174d2-42ff-4e26-bcfc-a848e97999cb service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:07.183504 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-8281ef66-cd01-4689-b892-8115531e324e req-677174d2-42ff-4e26-bcfc-a848e97999cb service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:07.194998 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-8281ef66-cd01-4689-b892-8115531e324e req-677174d2-42ff-4e26-bcfc-a848e97999cb service nova] Creating event network-vif-deleted:5773b105-f56f-4c3a-b6a5-26e99920cf83 for instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 on hv-cinder-85093 Jul 28 22:39:07.200255 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-8281ef66-cd01-4689-b892-8115531e324e req-677174d2-42ff-4e26-bcfc-a848e97999cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088785 Jul 28 22:39:07.200896 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 566/1129] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 22:39:08.135342 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:08.135963 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] [instance: dd665065-91f7-40eb-a474-2f0b80ffa9f5] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:39:08.142557 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:08.143013 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:08.143787 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:39:08.144228 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:39:08.157987 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] HTTP exception thrown: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Request method failure captured: Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 HTTP/1.1 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w-GyTmwityMbZg_T40Ph6TqZQcpQjxspEcYYn3W_LEGFnYZquaMqgtiaUk73F6cE5LEUCnAMxX1FGbClXCCm9F40cWF0unvW2fkoCNej5TxIb42MGPxt6TBUeo5gARRz7cIcZ3bxQqr2sMYh_DinKAtVxtBLRujoesJ8JIxaHPxi5E Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 651fa66c961b4d07a8fa735e63cdef79 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:39:08.159560 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_651fa66c961b4d07a8fa735e63cdef79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 651fa66c961b4d07a8fa735e63cdef79 Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-TestMinimumBasicScenario-884147374 Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-TestMinimumBasicScenario-884147374-project Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 2e64644dc881469e907a6f6669999757 Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-TestMinimumBasicScenario-884147374-project Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. Jul 28 22:39:08.161176 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': 'dd665065-91f7-40eb-a474-2f0b80ffa9f5'} Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:39:08.162144 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. Jul 28 22:39:08.163643 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:39:08.165056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Returning 404 to user: Instance dd665065-91f7-40eb-a474-2f0b80ffa9f5 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:39:08.165056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-36cea11c-3eb6-46dc-9213-32bda552c2df tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5" status: 404 len: 111 microversion: 2.1 time: 0.030257 Jul 28 22:39:08.165056 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 564/1130] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:39:08 2022] GET /compute/v2.1/servers/dd665065-91f7-40eb-a474-2f0b80ffa9f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 22:39:08.170666 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-5e851bcf-7143-4046-8d80-b124272053ce tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] Calling method '.version_select at 0x7f743c0405e0>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:39:08.189339 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-5e851bcf-7143-4046-8d80-b124272053ce tempest-TestMinimumBasicScenario-884147374 tempest-TestMinimumBasicScenario-884147374-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-843614531" status: 202 len: 0 microversion: 2.1 time: 0.023236 Jul 28 22:39:08.190025 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 567/1131] 10.222.0.39 () {58 vars in 1269 bytes} [Thu Jul 28 22:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-843614531 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:40:02.791949 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:02.795186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:40:02.796378 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG dbcounter [-] [118086] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:40:02.800495 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-d71281fa-5f32-422d-b055-2703ed5b7af8 req-830ff8d3-e33a-4932-829a-c9bc270a0214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e", "tag": "63c599f6-5106-4ad6-95ed-4585cd24b502"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:40:02.800768 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:02.803268 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_api:SELECT=14 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:40:02.803917 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG dbcounter [-] [118085] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=118085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:40:02.823136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:02.823581 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:02.824370 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:02.824806 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:02.831713 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d71281fa-5f32-422d-b055-2703ed5b7af8 req-830ff8d3-e33a-4932-829a-c9bc270a0214 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:02.832162 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d71281fa-5f32-422d-b055-2703ed5b7af8 req-830ff8d3-e33a-4932-829a-c9bc270a0214 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:02.843777 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-d71281fa-5f32-422d-b055-2703ed5b7af8 req-830ff8d3-e33a-4932-829a-c9bc270a0214 service nova] Creating event network-changed:63c599f6-5106-4ad6-95ed-4585cd24b502 for instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e on hv-cinder-85093 Jul 28 22:40:02.849544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-d71281fa-5f32-422d-b055-2703ed5b7af8 req-830ff8d3-e33a-4932-829a-c9bc270a0214 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055778 Jul 28 22:40:02.850705 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 568/1132] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:40:02.853212 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:40:02.942419 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-5b430491-e63a-497a-bd8a-e74d11271b11 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 204 len: 0 microversion: 2.1 time: 0.153947 Jul 28 22:40:02.943051 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 565/1133] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:40:02 2022] DELETE /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:40:02.953796 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:02.955319 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:02.964050 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:02.964522 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:02.965590 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:02.965773 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:03.104583 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:03.112782 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-328b852f-0065-4fb4-b278-ad6bb8df2a77 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1576 microversion: 2.1 time: 0.164366 Jul 28 22:40:03.113572 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 569/1134] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:02 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:04.136596 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:04.137371 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:04.144269 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:04.144716 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:04.145481 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:04.145935 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:04.278944 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:04.286571 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-83e3f443-da97-4a7b-9cec-6e423f17379a tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1576 microversion: 2.1 time: 0.154914 Jul 28 22:40:04.287136 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 566/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:04 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:05.308384 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:05.309001 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:05.315565 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:05.316022 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:05.316785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:05.317221 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:05.483767 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:05.492636 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-1e3d6925-102a-40af-b58b-e430ba288777 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 200 len: 1457 microversion: 2.1 time: 0.188473 Jul 28 22:40:05.493287 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 570/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:05 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 1457 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:05.501202 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [req-7ce29534-2644-427d-ae8e-9624916d69ee req-0f32d765-8c35-491d-b06d-757f662c470a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e", "name": "network-vif-deleted", "tag": "63c599f6-5106-4ad6-95ed-4585cd24b502"}]} {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:40:05.513664 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-7ce29534-2644-427d-ae8e-9624916d69ee req-0f32d765-8c35-491d-b06d-757f662c470a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:05.514105 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [req-7ce29534-2644-427d-ae8e-9624916d69ee req-0f32d765-8c35-491d-b06d-757f662c470a service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:05.527680 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.compute.server_external_events [req-7ce29534-2644-427d-ae8e-9624916d69ee req-0f32d765-8c35-491d-b06d-757f662c470a service nova] Creating event network-vif-deleted:63c599f6-5106-4ad6-95ed-4585cd24b502 for instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e on hv-cinder-85093 Jul 28 22:40:05.533635 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [req-7ce29534-2644-427d-ae8e-9624916d69ee req-0f32d765-8c35-491d-b06d-757f662c470a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036384 Jul 28 22:40:05.534221 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 567/1137] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:40:06.514361 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:06.514910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:06.521455 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:06.521938 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:06.522701 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:06.523139 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:06.538900 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] HTTP exception thrown: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Request method failure captured: Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e HTTP/1.1 Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w6LbQ_yK4ridboghV3696PM3uyFUA80fa8wOJHpvXh5HI5qyxH8QXG8BbrA8pBmskdgrbgK0l3a2v2BxTiBeT06JpczuFTgtYMMRV_h1oRYaA0gdGuYPAek83KBgXQYm6XzldAnTzTeRQtQZ-4nQYvOOswX1yNJuRJxEPJXZSBuhGo Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:40:06.541691 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 32eadc02f9224eb28303aab25506ef2a Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. Jul 28 22:40:06.543480 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e'} Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:40:06.544452 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. Jul 28 22:40:06.545910 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:06.547293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Returning 404 to user: Instance 9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:40:06.547293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0522053a-45a2-4bd0-baf6-c9bc6b122a55 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e" status: 404 len: 111 microversion: 2.1 time: 0.032762 Jul 28 22:40:06.547293 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 571/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:06 2022] GET /compute/v2.1/servers/9babb6f8-dca4-4f82-a3c2-dc0f24a5df6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:40:09.585286 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:09.591725 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-4fc7d0ee-065c-483a-badb-1bf48e72a3fe req-2c838d58-92aa-4785-8bb4-c519960cf382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a0bb72-6ab1-4e67-a33f-3f93da40cfee", "tag": "1c06568b-ba30-4d2c-81ad-0bf0c96c3645"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:40:09.597759 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:09.605954 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:09.606476 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-4fc7d0ee-065c-483a-badb-1bf48e72a3fe req-2c838d58-92aa-4785-8bb4-c519960cf382 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:09.606645 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:09.607027 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-4fc7d0ee-065c-483a-badb-1bf48e72a3fe req-2c838d58-92aa-4785-8bb4-c519960cf382 service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:09.607402 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:09.608006 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:09.619451 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-4fc7d0ee-065c-483a-badb-1bf48e72a3fe req-2c838d58-92aa-4785-8bb4-c519960cf382 service nova] Creating event network-changed:1c06568b-ba30-4d2c-81ad-0bf0c96c3645 for instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee on hv-cinder-85093 Jul 28 22:40:09.624596 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-4fc7d0ee-065c-483a-badb-1bf48e72a3fe req-2c838d58-92aa-4785-8bb4-c519960cf382 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037001 Jul 28 22:40:09.625511 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 572/1139] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:40:09.635537 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Going to try to terminate instance {{(pid=118085) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 28 22:40:09.727246 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-6300deff-7fb2-4824-9f44-03aa16181af9 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 204 len: 0 microversion: 2.1 time: 0.145717 Jul 28 22:40:09.729135 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 568/1140] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:40:09 2022] DELETE /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 22:40:09.739049 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:09.739851 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:09.747093 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:09.747693 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:09.748477 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:09.749668 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:09.889379 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.policy [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118086) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:09.897120 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-d05ce3c5-738c-4948-bd17-3140f72adf6c tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1577 microversion: 2.1 time: 0.163530 Jul 28 22:40:09.897745 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 573/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:09 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:10.919993 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:10.920686 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:10.926610 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:10.927054 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:10.928328 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:10.928841 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:11.060032 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:11.067540 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-d7bad40d-deba-46db-8f23-fa718ba78610 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1577 microversion: 2.1 time: 0.152959 Jul 28 22:40:11.068114 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 569/1142] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:10 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:11.988104 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [req-d660248d-d243-4543-8a65-ea8c9960a18d req-dac686ab-705f-41b2-a4c0-b37d8a7a25bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a0bb72-6ab1-4e67-a33f-3f93da40cfee", "name": "network-vif-deleted", "tag": "1c06568b-ba30-4d2c-81ad-0bf0c96c3645"}]} {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 22:40:12.000953 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d660248d-d243-4543-8a65-ea8c9960a18d req-dac686ab-705f-41b2-a4c0-b37d8a7a25bd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:12.001421 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [req-d660248d-d243-4543-8a65-ea8c9960a18d req-dac686ab-705f-41b2-a4c0-b37d8a7a25bd service nova] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:12.013820 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.compute.server_external_events [req-d660248d-d243-4543-8a65-ea8c9960a18d req-dac686ab-705f-41b2-a4c0-b37d8a7a25bd service nova] Creating event network-vif-deleted:1c06568b-ba30-4d2c-81ad-0bf0c96c3645 for instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee on hv-cinder-85093 Jul 28 22:40:12.018842 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [req-d660248d-d243-4543-8a65-ea8c9960a18d req-dac686ab-705f-41b2-a4c0-b37d8a7a25bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Jul 28 22:40:12.019441 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 574/1143] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Jul 28 22:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 22:40:12.088411 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:12.089085 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:12.095561 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:12.096011 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:12.096800 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:12.097331 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:12.160497 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.policy [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32eadc02f9224eb28303aab25506ef2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862a3f47ebe842fb8c5fbd4ef08f0b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118085) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 22:40:12.168827 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-122b4303-eeee-4662-bb51-f3f5ddb5b9a7 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 200 len: 1226 microversion: 2.1 time: 0.084528 Jul 28 22:40:12.169390 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 570/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:12 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 22:40:13.191275 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:13.191976 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 00a0bb72-6ab1-4e67-a33f-3f93da40cfee] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:13.198959 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.199410 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.200166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.200607 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.214544 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] HTTP exception thrown: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Request method failure captured: Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee HTTP/1.1 Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w6LbQ_yK4ridboghV3696PM3uyFUA80fa8wOJHpvXh5HI5qyxH8QXG8BbrA8pBmskdgrbgK0l3a2v2BxTiBeT06JpczuFTgtYMMRV_h1oRYaA0gdGuYPAek83KBgXQYm6XzldAnTzTeRQtQZ-4nQYvOOswX1yNJuRJxEPJXZSBuhGo Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:40:13.216147 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 32eadc02f9224eb28303aab25506ef2a Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. Jul 28 22:40:13.217918 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '00a0bb72-6ab1-4e67-a33f-3f93da40cfee'} Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:40:13.218941 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. Jul 28 22:40:13.220503 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.222015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Returning 404 to user: Instance 00a0bb72-6ab1-4e67-a33f-3f93da40cfee could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:40:13.222015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-0fc8a207-dbda-44f8-be84-0950b66b1453 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee" status: 404 len: 111 microversion: 2.1 time: 0.031135 Jul 28 22:40:13.222015 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 575/1145] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:13 2022] GET /compute/v2.1/servers/00a0bb72-6ab1-4e67-a33f-3f93da40cfee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:40:13.655892 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:13.657031 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.compute.api [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118085) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:13.664169 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.664657 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.665519 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.665994 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG oslo_concurrency.lockutils [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.679656 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.wsgi [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] HTTP exception thrown: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Request method failure captured: Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: request: DELETE /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 HTTP/1.1 Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept: application/json Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Accept-Encoding: identity Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Connection: close Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Length: 0 Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Content-Type: application/json Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Host: 10.222.0.39 Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Openstack-System-Scope: None Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: User-Agent: python-urllib3/1.26.10 Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Auth-Token: gAAAAABi4w6LbQ_yK4ridboghV3696PM3uyFUA80fa8wOJHpvXh5HI5qyxH8QXG8BbrA8pBmskdgrbgK0l3a2v2BxTiBeT06JpczuFTgtYMMRV_h1oRYaA0gdGuYPAek83KBgXQYm6XzldAnTzTeRQtQZ-4nQYvOOswX1yNJuRJxEPJXZSBuhGo Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Id: None Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Domain-Name: None Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Identity-Status: Confirmed Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Is-Admin-Project: True Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Id: default Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Domain-Name: Default Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Project-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Role: reader,member Jul 28 22:40:13.681463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Roles: reader,member Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-Tenant-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Id: default Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Domain-Name: Default Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Id: 32eadc02f9224eb28303aab25506ef2a Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: X-User-Name: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: method: > Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: exception: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.683195 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: action_args: {'id': '47525846-7437-4e19-acd2-70f0ea466207'} Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:40:13.684263 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.685905 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.687463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Returning 404 to user: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. {{(pid=118085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:40:13.687463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-388ddb96-99e5-4b42-926a-3d3f3242b1eb tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 404 len: 111 microversion: 2.1 time: 0.031035 Jul 28 22:40:13.687463 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 571/1146] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Jul 28 22:40:13 2022] DELETE /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:40:13.691785 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '>' {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:13.692426 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.compute.api [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] [instance: 47525846-7437-4e19-acd2-70f0ea466207] Fetching instance by UUID {{(pid=118086) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 28 22:40:13.699550 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.700004 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.700769 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 22:40:13.701205 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG oslo_concurrency.lockutils [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Lock "39a213b2-8d6f-4b22-9f78-f4ccc3b99c66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 22:40:13.715459 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.wsgi [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] HTTP exception thrown: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Request method failure captured: Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: request: GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 HTTP/1.1 Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept: application/json Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Accept-Encoding: identity Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Connection: close Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Length: 0 Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Content-Type: application/json Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Host: 10.222.0.39 Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Openstack-System-Scope: None Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: User-Agent: python-urllib3/1.26.10 Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Auth-Token: gAAAAABi4w6LbQ_yK4ridboghV3696PM3uyFUA80fa8wOJHpvXh5HI5qyxH8QXG8BbrA8pBmskdgrbgK0l3a2v2BxTiBeT06JpczuFTgtYMMRV_h1oRYaA0gdGuYPAek83KBgXQYm6XzldAnTzTeRQtQZ-4nQYvOOswX1yNJuRJxEPJXZSBuhGo Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Id: None Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Domain-Name: None Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Identity-Status: Confirmed Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Is-Admin-Project: True Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Id: default Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Domain-Name: Default Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Project-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Role: reader,member Jul 28 22:40:13.716964 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Roles: reader,member Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_862a3f47ebe842fb8c5fbd4ef08f0b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Id: 862a3f47ebe842fb8c5fbd4ef08f0b5f Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-Tenant-Name: tempest-TestVolumeBootPattern-90937874 Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Id: default Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Domain-Name: Default Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Id: 32eadc02f9224eb28303aab25506ef2a Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: X-User-Name: tempest-TestVolumeBootPattern-90937874-project Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: method: > Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: exception: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.718784 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: action_args: {'id': '47525846-7437-4e19-acd2-70f0ea466207'} Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: {{(pid=118086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 22:40:13.719619 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. Jul 28 22:40:13.720948 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: ERROR nova.api.openstack.wsgi Jul 28 22:40:13.722186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: DEBUG nova.api.openstack.wsgi [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Returning 404 to user: Instance 47525846-7437-4e19-acd2-70f0ea466207 could not be found. {{(pid=118086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 22:40:13.722186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO nova.api.openstack.requestlog [None req-04d81f66-78bd-489a-98c6-2d928ae5c61d tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207" status: 404 len: 111 microversion: 2.1 time: 0.030590 Jul 28 22:40:13.722186 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: [pid: 118086|app: 0|req: 576/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Jul 28 22:40:13 2022] GET /compute/v2.1/servers/47525846-7437-4e19-acd2-70f0ea466207 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 22:40:15.256857 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: DEBUG nova.api.openstack.wsgi [None req-e0e40f7c-bf2a-450f-89ce-b8795287b013 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] Calling method '.version_select at 0x7f743c47d040>' {{(pid=118085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 22:40:15.281449 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO nova.api.openstack.requestlog [None req-e0e40f7c-bf2a-450f-89ce-b8795287b013 tempest-TestVolumeBootPattern-90937874 tempest-TestVolumeBootPattern-90937874-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1305921694" status: 202 len: 0 microversion: 2.1 time: 0.028527 Jul 28 22:40:15.281989 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: [pid: 118085|app: 0|req: 572/1148] 10.222.0.39 () {58 vars in 1263 bytes} [Thu Jul 28 22:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1305921694 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 22:41:33.181233 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:41:33.181771 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:41:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:41:43.532563 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:41:43.533310 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:43:15.886091 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:43:15.886681 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Thu Jul 28 22:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:43:25.453432 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:43:25.454117 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Thu Jul 28 22:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:44:53.189166 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:44:53.189686 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:45:03.540545 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:45:03.541227 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:45:20.405935 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:45:20.406486 dv-cinder-850939-3-iscsi devstack@n-api.service[118086]: Thu Jul 28 22:45:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 22:45:22.526869 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 22:45:22.527938 dv-cinder-850939-3-iscsi devstack@n-api.service[118085]: Thu Jul 28 22:45:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!